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CHAPTESI 
. INTRODUCTION 

The Ability Development Program for five-year-olds has focused on the 
special needs of handicapped kindergarten children enrolled in bilingual 
classrooms with their non-handicapped peers. The primary puTT>ose of the 
Ability Development Program (ADP) was to develop and research the effective- 
ness of materials which would interphase with the previously developed 
Bilingual Kindergarten Program designed for non-handicapped children 
(SEDL, 1972) • The development of associated assessment instrumentation 
and supporting materials for teachers and parents were also proposed. The 
ADP was funded by the Bureau of Education for the Handicapped from June, 
1975 through May, 1977. The program Mas characterized by a "developmental 
^kther than "a deficit approach to problems in learning and was directed at. 
maximizing the learning which can occur when children of different abil- 
ities interact in the same classroom. A similar program for handicapped. 
four-*year-olds, also supported by BEH, was completed in 1973 (Evans, 1974). 
Products and materials designed during this earlier one-year project were 
further developed, tested and completed as a part of this program for 
five-year-olds. 

During the^ first year of the Ability Development Program for Five- 
Year-Olds, Supplementary Materials for children, teachers, and parents were 
designed and tested. In addition research was conducted for the purposes 
of validating assessment instruments and materials. During the second year 
the materials and. assessment instruments were refined, further validation 
conducted and child progress over a one year period of time evaluated. 

The Ability Development Program has resulted in field-validated 
products and resd^arch information. 



The following products were completed and are now commercially 
available : I 

♦ The Spanish/English Language Performance Screening (S/ELPSX 

A measure of language domin^ce which is designed for "use by 
the classroom teacher. 

Availability: CTB/McGraw-Hill 

Del MontJ^ Research Park 
Monterey, California 93940 

♦ Working With^ Parents of Handicapped Children 

♦ Trabajando con los padres de ninos con impedimentos 

Informational manuals for classroom teacheifs which focus on 
the feelings and attitudes of parents and teachers, designed 
for use by all teachers who have one or more* handicapped 
children in their classroom. 

Availability: Council for Exceptional Children 
1920 Association Drive 
Reston, Virginia 22091 

♦ How To Fill Your Toy Shelves Without Emptying Your Pocketbook 

» Como llenar sus estantes con juguetes sin gas tar tnucho dinero 

Instructional manuals on how to make and use inexpensive 
materials within the classroom or at home. 

Availability: Council for Exceptional Children - 
1920 Association Drive 
Reston, Virginia 93940 

♦ Supplementary materials for the Bilingual Kindergarten Program 

Diagnostic and remedial materials include a teacher guide, 
Entry Levol Checklist, Observation, information and Action 
Cards, Home Activities for parents, and Supplementary Media 
illustrating handicapping conditions. 

Availability: National Educational Laboratory Publishers 
813 Airport 
Austin, Texas 78702 
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Associated research reports and papers include the following: 

♦ Observational Checklists for Referral — Teachers and Parents Together 

♦ Observational Checklists for Referral : Technical Report 

» Spanish/English Language Performance Screening; Technical Report 

• Spanish/English Language Perfoimance Screening' (S/ELPS) : Extension of 
Reliability and Validity Studies with Cuban, Puerto Rlcan, and Mexican 
American Children, Preschool Through Third Grade 

Availability: ERIC ' r 

University of Illinois at Urb ana-Champaign 
805 -West Pennsylvania Avenue 
Urbana, Illinois 61801 
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BACKGROUND 



Initial conceptualization of the Ability Development Program was based 
on research that supported the need for (1) preschool intervention^ (2) integra 
tion of the handicapped child within the mainstream setting^ and (3) instruc- 
tion pf the young child in Spanish. ^ 

Rationale \ 

' ^ 

The rationale for preschool intervention was based on research with non- 
handicapped and handicapped young children (Weikert^ 19^7^ Kernes, 1969; 
Evans. and Bangs> 1972; Bronfenbrenner^ 1975 )• ' Integra'tion of the handicapped 
with the non-handicapped learner was based on a growing body of research 
beginning with Bennett (1932) when higher achievement rates for retarded 
children within the regular classroom were found. Subsequent research^ 
particularly in the last 10 years has shown that the handicapped child in the 
regular classroom progresses academically as well as or better than the 
handicapped child in a special class C^i^k^ 1964; Rubin^ et al . > 1966; Sinith^ 
Kennedy^ 1967; Johnson^ 1969 Blatt> 1970) . Other studies related to personal 
and social acceptance also tend to support mains treaming^ although some con- 
tradictions are evident in the literature (Sparks anHnslaclcma^ Vi65\ ~ ~ " 
Kennedy and Bruininks, 1974; Iano> 1974). 

Further supporting integration of the handicapped child > particularly 
the mild to moderately handicapped childj^ have been court decisions and 
opinion articles (Dunn, 1968). Education of all children within the least 
restrictive environment , was mandated in Texas under Plan A and across the 
nation with the passage of Public Law 94-142, the Education of all Handi- 
capped Children Act. 

» 
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Many cases in which minority children > particularly iton-English speaking 
children^ were inappropriately tracked into Special Education classes have 
been docuiaented (Calzonzit^ 1971; Johnson^ 1969). Court decisions also 
have impacted on education. In the Lau v. Nichols decision of 1974> the 
Supreme Court affirmed the right of children to initial instruction in their 
native language in order to effectively participate in the educational process 
At the same time> state' legislation and lower court decisions have mandated 
.that initial ithst ruction for the non-English speaking children be provided 
in their native language. This is particularly important in terms of the 
Southwest and Texas in particular. 

In Texas > approximately 25 percent of the school population is Mexican 
American and many young children speak Spanish as a first or only language^ 
In the Southwest (Arizona^ California^ Colorado^ New Mexico, and Texas) ^ 
there are more. than 720>000 Mexican American children five years of age and 
under. No exact data exists on the. number of children who (1) speak Spanish 
as a first language, and (2) are also handicapped. An estimate, however, can 
be interpolated from other available figures. Within Texas, it is estimated 
that some 16.1 percent of the school population is handicapped in one degree 
or another (Information based on^ figures-pa:avidadJxy-_theJirectoji^of^p.ec 
Education, Texas Education Agency, 1972). Of the 163,983 Spanish-sumamed 
three- to five-year-olds, it may be estimated that some 26,401 may have some 
type of handicapping condition. 

Thus* leeal. social, and educational changes over the past years created 

- ) 

a critical need for materials and programs geared for handicapped children in 
general and for young handicapped miriority children in particular. This need 
was particularly great for the young bilingual child. Limited instructional 
materials were available for preschool age Spanish speakers (Evans and Reyna, 
1974) and no materials were available, for the child who was also handicapped* 



( ... 

Developn^nt of supplementary materials for use with handicapped five-year^ 
old Spanish speaking children was particularly relevant and needed. The 
previously developed Bilingual Kindergarten Program (SEDLj 1972) was adopted 
by the state of Texas for public school use in 1974. However, this program 
was designed for the non-handicapped child and no provisions were included 
for children with various types of disabilities or children with general 
problems in learnings regardless of language, Howev€\r> the model and 
organization of the bilingual Kindergarten Program was stiited to adaptation 
through the addition of supplementary instructional materials. 

The Bilingual Kindergarten Program • • 

The following overview of the Bilingtial Kindergarten Program modej. is 

essential in understanding the interface of the Supplementary Materials 

developed as a part of the Ability Development Program. A more extensive 

descr^'-^nion of the program is included in Appendix A. 

> e Bilingual Kindergarten Program was founded on research and validated 

over a five year period with non-handicapped Sparfish speaking children. The 

goals of the -program are: 

1. To develop the child's motor skills ^ 

2. To develop the child's language skills in both Engldsh and-Spanl^h 

3. To develop the child's thinking skills related to basic concepts 

4. To assist the child in developing a positive self-concept 

« 

The maj-or elements of the program are: Visual > 'Auditory , Motor^ Ideas 
and Concepts > Syntax of English and English Vocabulary. Content Cor each 
element relates to the child's own background. All activities begin with 
lower level orders 6f skill competency and progress systematically to higher 
levels. Initial instruction for concept developiaent is in Spanish so that 

6j_o 



the child develops |)a3ic information in his or her first language before 
introduction to the saae concept in English. Instruc^tion begins with concrete 
objects > liioves to pictorial representation and finally to the synibolic levels 
At each step, the child's, ability is developed gradually through elaborating 
skills or learning nev applications of , previous skills in other contexts. . 
In addition to curriculum activities, the Bilingual Kindergarten Programg 
' also include Staff Development Materials, Parent Activities, a mathematical 
component, and dances and songs ot Spanish origins. . 

, • The instructional focus of the Ability Development Program was tp. develop 

and validate Supplementary Materials to interface with the Visual, Auditory, 

■ , < > • 

Motor, and Ideas and Concepts elements of the bilingual Kindergarten Program . 
Each of these elements include language development in both Spanish and in 
English throughout. , 



Program Objectives 

Objectives of the Ability Development Program included both product 

developmejcif ,. including product validation, and research on the impact of /' 

the product^ within the classroom. Specific objectives were:' 

To develop and test instructional activities to supplement the 
Bilingual Kindergarten Program / , 

2. To develop additional instructional guides for the classroom ' 
teacher to assist in working with handicapped children and their 
families 

3. *To develop and validate classroom assessment instruments 

4. To research effectiveness of the developed products and techniques 
in meeting the special instructional needs of handicapped children 
within the mainstream setting. i, 

The purposes of this report are to (1) describe the products and materials 
developed, including the process followed and field validation conducted 



during the first year of the project and (2) to describe the research con- 
'ducted in Implemehtfng the project on a wider scale during the second year 
of the project. Comprehensive reports of validation studies conducted with 
the two primary assessment Instruments developed, the Spanish /English 
Language Performance Screening and the Observational Checklists for Referral 
are included as separate documents and only summarized in this report. 
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( PROGRAM OVERVIEW . ^ " ^ 

The Ability Development Program (ADP) was designed to assist^teachfers 
of five-year-old Mexican American children using the Bilingual Kindergarten 
Program in working with those children who were also handicapped • The 
purpose of the ADP was the creation of Supplementary Materials which would 
Interface with the basic Bilingual Kindergarten Program a nd associated 

V . . . 

general use assessment instruments and materials, ^Rve intended target group 

''If ^ 
was to include only children with clearly identifiable handicapping conditiqns, 

/ 

i.e. y visual loss, speech impairment, phys/ical handicaps, learning disabilities 

- ~ ' it 

%n reality, ^ther children benefited frqm this project. Within each experi- 
mental classroom, there were children who learned e^^iiy, following the basic 
curricu''.um. Within each classroom there were also children who did not learn . 
as well as others. Those children who were not clearly identified by professional 
examination as having a handicapping condition perhaps benefited^most of all ^ 
from the Ability Development Program. With the addition..of- supplementary 
instruction by the end of 'the first few months of school, these children 
were progressing behindf the children who had no handicapping conditions. 
Although this group o/ children did not have clearly identifiable handicap- 
ping conditions', th^ project staff decided that it Was unrealistic to 
exclude them from the projects Therefore the project served two groups of 
children: (a) those with identifiable handicapping conditions, and (b) those 
with non-specific handicaps but who were not learning at a typical or normal 

■' • / ' ■' ^' 

rate as compared with the, fully-functioning group, 

7 

In order io develop activities for mains treaming children within the 
basic bilingual program the following objectives were established and 
implemented/ 

er|c . . / . 9I5 
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!• To Identify^ develop and validate assessment instruments suitable 
' for. Mexican American children 

2* To develop instructional materials for the target children; these 
materials wer^ developed in the form of supplementary activities 

3. To -develop appropriate materials to assist teachers with minimal 
training in working with handicapped children 

1/ 

4» >To develop materials for working with parents of preschool handi- 
^ capped children 

5* To identify target children and implement supplementary instrtiction 
to research the effectiveness of the materials in assisting children 
- - in learning 

The procedures followed to meet these objectives are summarized below 

by program year and discussed in detail in the follow:{,ng sections* 

First Year Overview ^ ^ ' . 

^During the first year of the project^ primary focus was on the design and on 
the initial design testing of materials and assessment instruments on a 
limited basis under direct supervision of the project staff. In order to 
work directly^with the teachers and their children^ day care centers 
serving five-year-old children were seXected in *Ausitin^ Texas. This included, 
two classrooms of five-year-old children in an integrated' setting'^ i.e*^ 
Mexican American^ Black and Anglo children in which' the Bilingual Kindergarten 
Program was used> and four kindergarten classrooms in the Edgewood Independent 
School District^ San Antonio^ Texas* In the Edgewood site all children were 
Mexicati American* No attempt was made tO' select or place handicapped 
children within the San Antonio classes. However > within the ^lustin Day 
Care Center when Mexican American children with problems were identified at 
other centers > they were transferred to the project center. ^ 

All teachers were trained in in5)lementanion of the basic program by an 
experienced SEDL training specialist. The teachers also received in-service 
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training in implementation of the basic curriculum as weU as implementation 
of the Supplementary Materials and use of the assessment instruments. During 
this-^ear the primary goal was to design the Supplemental]? Materials and 
assessment instruments and to collect formative evaluation data in order to 
revise them. for more extensive testing the second year. 

During the first year of the project, validation of the Spanish/English " 
Language Performance Screening vras conducted with five-year-old children. 
Also, a validation study of another assessment instrument, the Observational 
Checklists for Referral, was conducted. Revisions of the following teacher 
training manuals were completed: Working with Parents of Handicapped 
Children; Traba jand o con los nadres de ninos. con impedimentos ; How To Fill. 
Your Toy Shelves Witho ut Emptying Your Pocketbook : Como llenar sus estantes 
con .iuguetes sin gas tar mucho dinero . These manuals had been initially 
designed but not completed under a previous grant. These instyuctioilal 
manuals and the S/ELPS were submitted to publishers following USOE 
procedures for commercial publication and dissemination. 

Thus, at the end of the first year of the project two assessment instru- 
ments had been field-validated. Supplementary Materials had been designed, 
tested, and revised; and .English and Spanish versions of two training 
manuals were completed. In a^ddition, classroom^t^chers were trained, ana 
ready to move into implementation of the Supplementary Materials during the. 
• second year of the program. 

Second Year Overview 

During the second year of the program, two classrooms in the' Austin Day 
Care Centers were initially included as well as six classrooms in the Edge- 
wood Independent School District. The project staff continued to work with 



the Austin day care centers during the second year of the project*^ However j 
the student turnover rate was sq high that the data collected on the children ^ 

' ' I ■ '• ■ 7 

were insufficient for analysis^ in the final report. A major problem was that 



free publfc school kindergarten, had become available to all children. Con^ 
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sequently, many parents removed their children from the day care center ^aad 
enrolled them in the public/ schools • Another problem was that of a chalnge in 
the income level requireme/ts for free day care services. Many children had 
to be withdrawn from the .center because their**families were -"over incyme". 
Therefore, within a period of nine months the^fe was a turnover of approxlinately 

75 per cent in these classes. The datd from tliese groups were insufficient. 

/ > t 

^. In the Edgewood school district five classes were originally included 

in September, 1976. Two ;,classe^ were designated as "control clas^eSsr^'V classes 

in which the, basic curriculum Bilingual Kindergarten Program was used and 

no Supplementary Materials were implemented. In four classes phe Supplementary 

/ . 

Materials were used in additioti to the Bilingual Kindergarten Program . In 
one class only initial data were completed. The classroom teacher did not 
consistently report inf rmation on the ctiildren* These data were also 
insufficient for final analysis. " ' 

The data reported for the second year of thfe program were based on a 
comparison of the data from four classrooms, one control classroom and three 
experimental classrooms in which the Supplementary Materials were used. 

t 

Rej^ults 

-I ' ■ .^"^ 
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The first objective of theQfcoject was to identify ai^d/or develop 



r ' . ^ / / 

r appropriate assessment instruments. In order to determine whether to test 

. children in English or in Spanish, it was first necess'ary to develop a means 
of quickly determining the child's dominant or pr,ef erred language. There- 

/ ' . . "IS 



fore, the Spaaish/Engllsh Language Performance Screening (S/ELPS), was validated 
with flve-year'-old children to meet this need. The S/ELPS is designed to be 
administered and scored in leaTs than 15 minutes by any bilingual person and 
used as a guide in teaching children a new language or in grouping children, 
for classroom activities. Development of the S/ELPS is described elsewhere 
and a summary is included in the following sections. 

In or<?3r to assist project teachers in identifying children with poss^-ble 
\ problems, and" to provide the teachers with a basis for referring children^ the 
Observational Checklists for Referral (OCR) were developed and validated. 
The OCR is a checklist type screening instrutoent consisting of an instructional 
guide^ one general and seven specific checklists in the area of Healthy 
Vision,' Hearing, Speech, Motor, Behavior, and Learning. The OCR is designed 
to- aid teachers in identifying children who should be referred to other 
professionals. The OCR was administered to all project children during the ^ 
pretesting period. The development of the Observational Checklists for ^ 
Referral is also described elsewhere and a summary^ is included in the ^ 
following section. ^ \ - 

In order to assess entry level abilities of the children a criterion- 
referenced pretest from ^he basic bilingiial program was administered to all \ 
children. In addition, an Entry Level Checklist was developed and utilized 
in the project classrooms. * ^ . ' : ' 

, Therefore, the first objective was met^ through the development of the 
Spanish/English Language Performance Screening ^ the Observational Checkllsta 
for Referral , and the Entry Level Checklist. 

The second objective was to develop instructional materials for class- 
room use to supplement the basic program. Design and initial testing of the 



Er|c . 13 



19 



Supplementary Materials began during the first year of the program. Formative 
feedback was obtained from day care and public school classroom teachexjs of 
five-year'-olds. This feedback data and reviews by external consultants were 
followed in revising the materials during the summer of 1976. ! 

These materials provided a means of identifying needs and lndlvi<^tializing 
instruction for the handicapped child within the regular Bilingual Kinder-- 



g^rten Program . The Supplementary Materials include: a | 

Instructional Guide - Instructions on how to use the Supiplementaty ... - 
Materials. i'^ 

Observation Cards - For use in identifying specif ic behaviors 1.ti the 
Visual, Auditory, Motor, and Ideas and Concepts lessons -and to /provide 
\immediate^te"chniques fqr simplifying the task or determining wliere 
skills break down. 

Information Cards - Provide general informatio'n, ways of handling 
problems, suggestions for classroom management, and specific Informa- 
tion^on different types of handicapping conditions. 

Action Cards - Provide alternate ways of teaching a task or smaller 
step activities for meeting and reinforeiitg lesson objectives.- 

A third objective of the project was to develop materials to help 

teachers in wqrking with handicapped children within the regular classroom. 

In addition .'to the instructional manual^, which accompany the^ S/ELPS, and 

the Supplementary Materials, two instructional manuals. Working with Parents 

' J' 

of Handicapped Children and How To Fill Your Toy Shelves Without Emptying 

Your Pocketb.ook , were completed and submitted for publication by the Council 

j w _ i , ^ " - 

for Exceptional Childr.en. These manuals^ each of which is written in Spanish 

i . ^ I , 

as well as jEnglish^are briefly described in the followiiig sections. 

I I 
The fourth objective of - the program was to develop,. instructional 

activitiesj for parents to use at home with their children. A series of 

activitiesj were designed and reviewed by .parents of handicapped children. 

These activities were then revised and tested on a limited basis during the 
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.second year of the project. These pareu- activities are desigtieji to accoB?)any 
the Supplementary Materials • 

In addition to written materials > training films trips have also been 
developed. One of these, "The Ability Development Project for Five-Year- 
Olds/' provides an overview description of the total p-oject and how the 
, _ various materials, strategies for instruction and activities interface with 

one another. The overview filmstrip has been usee? for presenting information 
on the Ability Development Program as well as for preparation of teachers in 
initial implementation of the program. . A second filmstrip, "Ihe Observational 

• ^ ' ' '/ " 

Checklists for Referral," was originally designed as a training film for 
teachers planning to use the checklists. It has also heen used as an over- 
\riew presentation for various professional groups. 

An unstated goal of the project staff was to complete products and place 
them in the field as quickly as possible. Dissemination of information on 
the program occurred throughout the project period. No direct effort was 
made to advertise product availability as. the products were only available 
^ for limited use by test site teachers. Awareness of the products, however, " 
evolved from professional presentations and through word of mouth. A number 
of requests were received for the various products throughout the project 
period. Figures and discussions on requests received are included in the 

" ' section titled "Dissemination." 

i 

The niimber of requests created a problem for the project staff. A great 
deal of staff time and project money were expended in responding tS" letters 
of request. Funds for massive or extended publication and dissemination of 
materials^ particularly of training manuals, were not included in the proj'^iSct 

"i 

. budget. After the original limited number of copies (approximately 100 of each 
manual) had been distributed to project teachers and of'her involved persons, 
^ the remaining copies were distributed free of charge. At that point,, it became 

_ . , 15 21 , 



quite obvious the,:: continuing reproduction and dissemination v*lthout cost 
reimbursement was not feabible. During thfe last year of the project > field 
versions of the manuals were reprinted and actual printing costs charged to 
those requesting copies, with the pi^ovision that formative evaluation be 
provided to the staff. Commercial publishers were solicited as soon as the 
products were ready fo.r publicatibijl. The S/ELPS became commercially available 
through McGraw-Hill in the Fall of | 1976. Four training manuals were published 
by the Council for Exceptional Chmdren from Novanber, 1976 through February , 
1977. ' - I ' ^ ^ 

McGraw-Hill received numerou^ requests for use of the S/ELPS^ with older 
children as well as with Puerto Rican and Cuban children* To i;ieet the piibli': 
demand, McGraw-Hill contracted with the project staff for validation of the 
»S/ELPS with kindergarten through third grade children of Puerto Rican, Cuban, 
and Mexican American families. |This validation study was completed in the 
spring of 1977- ^ 

In summary, this project Hias resulted in (1) development and validat-iori 
of products which are already in'^ commercial distribution, (2) research on the 
progress made by handicapped Children when provided supplementary instruction, 
and direct services, in t^rms of teacher training as well as child 
instruction. Twenty-four tea^chers and assistant ' teachers have participated 
in training over the two yes^ period. Two hundred forty children, some of 
whom were thought to be handflcapped, have also received services as a direct 
result of this project. 

This project's scope of work incr.!<les research, development, and service. 
Therefore, the remainder o^ this report is divided into two primary sections: 
(1) product development'^d (2) research. In the section on product deve- 
lopment, the products, metihodology used in developing these products, subjects 
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and tl|ie results are described for the Supplementary Materials, the Spanish/ 
English Language Performance Screening , and the Observational Checklists f or 
Referral > The second section, titled Pilot Research, describes the results 
of utilizJjag these products and a comparison of child progress. Three strata* 
gies are employed for reporting this information— descriptive, statistical 
and case-&aidy« - , a. 
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C H A T E R II 
PRODUCT DEVELOPMENT 



INTRODUCTION ' ^ 

This chapter provides a description of the main accomplishment of the 
Ability Development Project — the development of products useful to the class- 



room teacher with little background in specia education for working^with 
mild to moderately handicapped maljistreamed Mexican American pupils in a 
bilingual kindergarten program. Four products are are discussed: (1) The 
Spanish /English Language Performance Screening (S/ELPS) , (2) The Observational 
Checklists for Referral (OCR), (3) Instruction Manuals, and (4) Supplementary 
Materials • As appropriate., each section t)rovides background information, 
details of the developmental process, analysis of formative data, final 
description, and dissemination statistics and plans for each of the products. ' 
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"Jl THE SPANISH/ENGLISH LANGUAGE PERFORMANCE SCREENING (S/ELPS) 

Introduction 

r 

\ 

The Spanish/English Language Performance Screening CS/ELPS) was con- 
ceptualized and designed as a part of "A Project to Develop Cxirriculum for 
Four-Year-Old Handicapped Mex5xan American Children" (Grant OEG^O-0 74-0550) 
and was completed tmder the current project for five-year-olds. 

In 1976 the S/ELPS was submitted for a commercial p«^blisher bid through 
Publishers Alert and the U. S. Office of Education^ ' It was published by 
CTB/McGr'aw-Hill^ Monterey^ California in late fall^ 19.76. To extend the use-, 
fulness of the S/ELPS, CTB/McGraw-Hill supported additional research with 
Cuban, Puerto Rican and Mexican American children- through third grade; the^e 
studies were completed in Spring, 1977. j 

Only summary information on the S/ELPS and the con5)leted research is 
included in this report as detailed reports are available in the following 
ERIC documents: 

1. Evans, J. S. A Project to Develop Curriculum for Four-Year-^ld 

Handicapped Mexican American Children , Final Report, Bureau of Education 

for the Handicapped, Project No. H 33-3640, November, 1974. 

(Includes information and data on initial design and research conducted 
with four^year-old Mexican American children in Texas) 

2. Evans, J. S. Technical Report: Spanish/English Language Performance 

Screening . Project No. 443 CH 50237, Grant No. GOO- 75-005 92 , March, 1976. 

(includes data on research conducted with five-year-old Mexican American 
children In Texas) 

3. Evans, J. S., Butler, J., Schmidt, J., and Zurilga, B. The Spanlsh/Enf^lish 
Language Performance Screening: Extension of Reliability and Validity 
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Studies with Cuban^ Puerto Rlcany and Mexican American Children^ Pre- 

School through Third Grade » Submitted to ERIC in July, 19^/. 

'(includ.es Jbrief summary o£ earlier studies and data on extended studies 
as indicated by'tae title) 

A summary of tue first two reports also included in Section F:^ 
Technical Information, of the Examiners Handbook, Spanish/English Language 
Performance Screening , CTB/McGraw-Hill, Monterey, California, 1976. 

Instrument Overview 



The Spanish/English Language Performance Screening CS/tl^PS.) is an oral 
language test designed to assist the classroom teacher Inr objectively 
determining each child's stronger or dominant language for initial Instric- 
tion. The S/ELPS may also be used to iden^'.ify a child's dominant language 
prior to administration of other tests or for assessing changes in oral 
language performance. ' 

The S/ELPS. was developed as a method of comparing the Spanish versus 
English oral receptive and expressive language performance of chj.ldren whose 
home language may be Spanish. It does net zovxpoxe the performance of one 
child with that of another and is not a competitive test. Neither is the 
S/ELPS an "intelligence" tgst or a mc-sure of academic achievement,, i.e., 
reading ability. The purpose of the S/ELPS is ^to obtain consistent, objective 
samples of the child's oral performance in each language and to conqpare th'e 
quality and quantity of Spanish and English responses in order to determine 
the' child's preferred or Jominant language. The Spanish and English parts ^ 
consist of p^jrallel items which have been tested for equivalency. This is 
in contrast to many tests which have Identical or translated forms. 
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Description " 



The S/ELPS administration kit includes the following materials: , 

^Manuail - iBclpdes all directions; for administering the S/ELPS^ instructions 
for assigning language categories > sample case studies » guidelines for 
using the S/ELPS language categories for instructional grouping, and 
technical information. 

Manipulatives - two boxes of the following miniature objects: 

Box 1 (Spanish portion) cup> plate, spoon, comb, mirror, watch 
Box 2. (English portion) baby, bottle, bed, chair, table, scissors 

Pictures - 8 x 10 color pictures to elicit oral descriptions, illustrating 

familiar scenes • . ■ x 

Spanish and English record forms - the forms include stimulus questions and 
a summary classification table, as well as .spaee;If or, recording responses 

The S/ELPS test consists of two parts. Part. I, the Spanish section 

(admivlstered first), and Part II, the English section ^administered second)-i 

Each section follows the same five-step sequence of questions and presenta- 

tlon of materials, as follows: > 

!• Simple familiar questions such as, ^'iComo te llamas?" or "How old 

are you?" are asked to put the child at ease and establish the 

language set. 

2. Naming of miniature objects familiar to young children (Spanish - 
cup, plate, spoon, comb, mirror, watc'^ English - bottle, bed, 

, . baby, table, chair, scissors). ^ 

3. Following siii5)le directions using the above mentioned objects^ such 
'as "Pon el reloj en la caja" or "Put the scissors in the box." 

A J Describing the objects or their use. 

5. Describing pictures of familiar scenes* For the Spanish part, these 
are* pictures of a mother and two children bathing and of a pinata 
birthday party.c For the English part, these are pictures of a play- 
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ground scene and of a father and two children at a circus, 



'^''^ LanR^atfee tWtegories 



- 

Responses ta the^' Spanish portion and to the English portion are rated 

. and then compared to obtain a category rating* These ratings are: 

Category 1 - Spanish : The child speaks only Spanish and little or no English* 

Category 2 - Predominantly Spanish : The child speaks Spanish as the stronger 
or dominant language > but can also conmunicatevto a limited extent in 
English. / 

/ ' 
Category 3 - Biltogual : The child speaks both English and "Spanish. The 

child may speak the tvro languages separately or may blend both languages. 

Category 4 - Predominantly English ; The child speaks English as the stronger 
X or dominant language > but can also communicate to some extent in Spanish. 

Category 5 - English : The child speaks only English and little or no Spanish. 

Category 0 - Unclassified ; The S/ELPS does not yield a sufficient sample of^ 
the child ^s language on which to base a determination of which language 
is stronger for children who do not respond in either language or for 
whom an insufficient language sample is obtained. 



Theoretical and Conceptual Background 

Initial development of the S/ELPS was based^on Piagetian concepts , an 

1 2 

information-processing models * and clinical experience. It was desigtied.^^ 
to sampl*e receptive^ inner, and expressive language abilitieis of young 

children, to move from the concrete to the slightly more abstract, and to 

*• *■ * ' ' 

move from direct child focus Lo a more general focus. Receptive and inner 

*» 

1. Osgood, C. E. "A Behavioristic Analysis," in Cm temporary. Approaches to 

Cognition . .Cambridge, Massachusetts: Harvard University Press, 1957. 

2. Osgood, C. E. "Motivational Dynamics of Language Behavior," in Nebraska 

Symposium on Motivations Lincoln, Nebraska; University of Nebraska Press 
1957. 



language . is assessed by observing the way in which the child attends to and 
processes information or instructions in responding to directions and simple 
questions throughout the test. At the non-verbal level, inner language is 
Inferred l?y the child's manipulation of related objects in a meaningful way. 
Each set of objects includes a group of three related objects (cup, plate, 
spoon or baby, bottle, bed), two related objects (comb, mirror or table, 
chair) and an unrelated object (watch or scissors). Expressive oral language 
is assessed through the way in which the child labels and describes objects. 
Initial parts of the test focua directly on the child through asking questions 
of direct relevance to the child. Toy replicas of familiar objects are used 
for manipulation, naming, following directions, and describing. In the final 
section, pictures, which are a more abstract representation, are used to 
elicit oral expression. 

Item Selection 

In development of the S/ELPS, the following criteria were applied in 
selection of items: ' 

1. The tasks presented should be well wfthin the developmental capaci- 
ties of young children. Thus, the child's perforinance on an item 

would depend ort the. ability to understand and use language rather 

/ 

than upon intellectual ability. 

2. The screening should include similar, but not identical items in 
English and in Spanish. * ' ' I 

3. The items were to sample a variety of language activities (Answer- 
ing Questions, Naming Objects, Following Directions, Describing 
Objects, and Describing Pictures). 

«. 
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4i — The i tem s wer e— to be interesting aad_enjoyable enough to stimula-te 

the child to speak freely and at some length. 
In selecting the toy objects, 5S Mexican American four- and five-year- 
old children were presented with a pool of 35 familiar objects which were 
under consideration for inclusion in the test* The children were then asked 
to name each of the object^. Those objects that were giVen inconsistent 
labels and objects that were labeled with three or more different identifiers 
were not included in the test, A total of twelve objects were selected for 

inclusion in the first version of the S/ELPS; six of, the 12 objects were 

" • 

includecl in the English part of the test and the other six were inclxided in 
th6 Spanish part of the test. 

The method used to select pictures for inclusion in the S/ELPS was 
similar to that used in selecting objects. The same group of 58 children who ^ 
participated in the object selection study were also asked to respond to, a 
pool of eight pictures illustrating familiar scenes within the home and 
school. The children were asked to describe the pictures and their responses 
were recorded. Those pictures that received little or no response were 
eliminated. Six pictures were initially selected for the design version 
of the S/ELPS. The number of pictures was reduced to four (two for the 
Spanish part and two for the English part) after. this phase of development 
because children gave sufficient spontaneous verbalization to four pictures. 
Length of^.administration time and ultimate cost could thus ,be reduced without ^ 
loss in accuracy. The four pictures selected for inclusion were those that 
producecj the most lengthy responses in both languages. For the Spanish part, 
these pictures were scenes of two children and a mother frying one of the 
children in a bathroom and a group of children playing with a pinata. . Based 
on the recommendations of examiners and classroom teachers during the design 
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test phase of development > a birthday cake was added to the pifiata scene. 
For the English part^ one scene was qf children playing on outdoor play 
equipment and the second scene contained a father and two c^iildren> a clown 
and balloons. 

Formative Research Regarding Reliability and Validity 

Following Object and picture selection^ the S/ELPS was reviewed for 
face validity > the initial version was administered by classroom teachers in 
day care centers^ formative evaluation was obtained^ and validation studies 
were conducted. The S/ELPS was field tested and validated with four- and 
five-year-old children enrolled in day care centers and public school ^ 
kindergartens in Texas. More than 500 children and 25 examiners participated 
in the various aspects of these research studies • Restilts and findings of 
these two studies are detailed in the reports listed on page 12. and summarized 
in the following table (Table 1_) . 

Extended Research Regarding Reliability and Validity 

* «i* 
On the basis of the above studies^ the S/ELPS was confirmed as a valid 

and reliable measure of the dominant language uf four- and .£ ive-year-^ld 

Mexican American children in Texas. < Following. U. S, Office of Education 

guidelines > the S/ELPS was submitted through the Bureau of Ecacation for the 

Handicapped for bids from commercial publishers. Announcements of the 

availability of the S/ELPS fo^ publication were sent out to commercial 

publishers through Publishers Alert and CTB/McGraw-Hill received the^-^ron tract. 

The S/ELPS kit. was prepared and became available commercially from CTB/McGraw- 
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Table 1 



Summary Results: S/ELPS Reliability and 
Validity Studies A &'B 





Age 


Origin 


Location 


Test 


Pearson 
Correlation 


Study A • • 


. 30 


4 yr. 




Texas 


Criterion Validity*/ 


.86 


. 30 


4 yr. 


Mex. Amer. 


Texas 


Test-Retest Reliability 


.93 


30 


4 yr. 


Hex. Amer. 


Texas 


Interrater Reliability 


.99 


.14 


4 yr. 


Mex. Amer. 


Texas 


Intrarater Reliability"*"- 


.99 








Study B 






223 


Preschool/ 
Kind. 


Mex,* Amer, 


Texas 


Criterion Validity * 


.85 V 


81 


'Preschool/ 
Kind. 


Mex. Amer, 


Texas 


Test-Retest Reliability 


.88 



* S/ELPS scores coiq)ared to teachers' "ratings of language dominance ' 

+ Procedure: Rescore of tape recorded second test administration by 
person performing first test administration. 
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Hill^ Monterey^ Caiitornia, in the Jb'aii of -1976-4 ^ ' 

Recognizing the need for additional data on the S/ELPS regarding usability 
with other Spanish-speaking groups and with children in the early elementary 
grades » CTB/McGraw-Hill provided the financial support for a third study of 
validity and reliability. Thus> during the period of September^ 1976 through 
February^ 1977^ the S/ELPS was administered to kindergarten through third . 
grade Mexican American^ Cuban and Puerto Rican children in order to determine 
the reliability and validity of the S/ELPS for use with a wider population 
than had been previously tested. Thirty-five examiners tested 742 students.*^ 
•in Arizona^ California*, Florida, Pennsylvania, and Texas in an effort to 
further specify the criterion and concurrent validity of the S/ELPS as well 
as the test-retest, interrater, interscorer and intrarater reliability of the 
instrument. . Table 2 contains a Subject/Examiner Summary. 

The results of this extended study are described briefly in this section 
while a more complete description of test sites and examiners, testing prdce- 
dure and results is found in Appendix A. 

Criterion-related validity . Table 3 presents the correlations obtained 
between S/ELPS scores and teacher classifications of language dominance (used 
as criterion) by grade level, by Spanish language subgroup, and by site* The 
resulting validity coefficients range from a high of .96 for Mexican American 
kindergarten pupils in Arizona to a low of ,41 for Mexican American third • 
grade pupils in Texas. Correlations were generally highest for younger pupils 
(e.g*^ kindergarten through second grade). Coefficients for both Mexican 
American and Cuban pupils were also more than adequate. Data collection 
problems, discussed further in the appendix, precluded obtaining comparable ' 
validity coefficients for Puerto Rican pupils. Other analyses, also discussed 

» 
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. Table 2- \ 
Subject/Examiner Summary 



Origin 



' Mexican 
American 



— \^ 



Site 




Puerto 
Rlcan 



School District A 
School District B 
(concurrent validity) 
San Antonio^ Texas 



Yuma, Arizona 



. San Diego, California 



Miami,/, Flori 




\ethlehem, Pehnsylvania 



\ 




"NuiQ&'er-o'f Grade- 
Children Levels 



145 
53 

198 



93 



166 



84 



201 



Examiners 



1--3 



K-3 



K-3 



K-3 



K-3 



Classroom 
teachers r 
asrslstants^* 
and SEDL staff 



Assistant 
teachers un- 
known to 
children 



Students of 
the U. S. ■ 
International 
University 



Resource 
teachers and 
parents with 
limited 
familiarity 
with children 



Teachers ' 
unknown to 
children 



Test 

Conditions 



Child's classroom 
and hallway 



School Cafeteria 

and- vacant 

classrooms 



Child's classroom 
and vacant 
vacant classrooms 



Outside child's 
classroom and 
school cafeteria 



Resource rooms 



"B ate of 
Testing 



Sept. 76 



Oct. 76 



Dec. 76 



Oct. 76 



Jan. 77 









Kindergarten 


Grade 1 


Grade 2 


Grade 3 


Total 


Location 


?upil Origin 


N 


Corr. 


N 


Corr. 


N 


Corr. 




Corr. 


N 


Corr. 


Texas 


tjlxican Aider, 








OQ 


Aft 


. /I 


CA 


.41 


1 A C 

145 


• 73 


Arizona 


Mexican Amer^, 


40 


.98 


18 


.59 


35 


.82 








• Of 


California 


|((exican Aner, 


43 


.79 


40 


.77 


42 


.43 


41 


.56 


i66 


.68 


Tx, AriZjjCal 


All Hex Amer. 


83 


.93 


105 


.84 


125 


.81 


91 


.51 


404 


.82' 


Florida 


Cuban 


21 


.84 


18 


.90 


19 


.93. 


26 


.66 


84 


.83 


Tx, Ariz, Cal, 
Fla 


All Mex Amer* 
and Cuban 


104 


.92 


123 


.84 


144 


.82 


117 


.51 


*488 


.83 

« 


Pennsylvania 


Puerto Rican 


30 


.50 


65 


.69 


32 


.70 


54 


.45 


201 


.64 



Note: All correlations are between teacher ratings and S/ELPS scores of pupil language dominance; 
Puerto Rican data is kept separate because dif ferment teacher rating criteria were employed, 
Pearson's product moment correlations are reported. 
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further In the appendix and later in this chapter, indicated site-related 

~ — — — - ■ » • 

factors to be affecting results. 

Concurrent Validity * Concurrent validity was evaluated by comparing 
performance on the S/ELPS with performance on the James Test of Language 
Dominance. Approximately equal numbers of students from each grade level 
participated. Person's product moment correlations were computed to determine 
the degree of agreement between S/ELPS and James scores. This analysis 
yielded a validity coefficient across all grade levels of .86* '*^he3e results 
indicate a high degree of concurrent validity when comparing the results of 
the S/ELPS to that of the James. Table A contains a summary of this data. 

Test-Retest Reliability . Testrretest reliability of the S/ELPS was 
determined by readministering the S/EI3PS to a sub-sample of students at each 
grade level at each test site (Total N » 326). Students were retested from 
one to three days following the first test administration. Although students 
were retested under conditions similar to those in the first test administration, 
in approximately half of the cases, a different examiner retested the student. 
A Pearson's product moment correlation was performed comparing the scores 
of the first test administration to those obtained on the second administration. 
The results of this analysis yielded a reliability coefficient of .84. Sum- 
marization of this data is also found in Table 4 . 

Interrater and Interscorer Reliability . Ih order to determine the consis- 
tency of the S/ELPS scores between different examiners, two methods were em- 
ployed: First, two examiners tested the same child on two separate occasions 
(N 153). Additionally, the 4:est protocols of a sample of 5 subjects at 
each grade level from each test site were rescored by a different examiner 
(total N « 90).. 

o • • 
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Table 4' 



Study C: Concurrent Validity, Test-Retest Reliability 



Interxater Reliability and Intrarater Reliability Data Summary 



Test 


K 


Origin 


Grade 
Level 


Pearson I 
Correlation. 


Concurrent Validity* V 


53 


Mexican American — 


• K-3rd 


.86. 


Test-Retest Reliability 


326 


- Mexican Amerlcaii 
Puer::o Rican> Cuban 


K-3rd 


.84 


Interrater Reliability 


153 

* 


Mexican American 
. Puerto Rlcan> Cuban 


K-3rd 


.87. 


. Interscorer Reliability 


90 


Mexican American 
Puerto Rican> Cuban ' 

f 

Mexican American 
Puerto Rican, Cuban 


K-3i;d 


.97 


Intrarater Reliability 


173 • 


K-3rd 


.81 



comparison of S/ELPS with James Test of Language Dominance 
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Peardon^s product moment correlations were computed to measure the degree 
of agreement between the two test scores for each student when tested^ ¥y " 
different examiners. This analysis yielded a reliability coefficient of .87. 
A Pearson* s product moment correlation was also used to determine the degree 
of agreement between the test scores and the scores obtained upon rescorlng. 
This analysis yielded a reliability coefficient of .97. A suirmary of the 
correlational data obtained in this pert of the study is also found in Table 4 

Intrarater Reliability . A sub-sa'aplo of 173 subjgSts were- r^tested on 
two occasions by the same exam.^«ner. Subjects from each grade level at each 
test site were retested in this condition one to two days following the first 
administration of the S/ELPS. A PearsonS product moment correlation was 
employed to determine the degree of agreement between the two S/ELPS scores 
for each individual. This analysis yielded a reliability coefficient of ,81. 
Tables Includes a sunsnary of these findings. The difference be;i.i^een the 
correlation coefficients for retest data for same ;^caminer (r » .81) versus 
that retest data for different examiner (r « .87)*was analyzed to determine 
if the difference between coefficients was signiflcarft. The results of this 
test indicated that the difference between the correlation coefficients was 
not significant. 

Supggary and Discussion ^ 

Generally, it can be stated that sound methodsf of test development . 
were employed and recorded, leading to the .creation of an instrument which 
met well its objective of providing a brief > easy-to-administer test of oral 
language -dominance (Spanish/English) for use by the classroom teacher. The 
t.hree studies completed to date indicate adequate to iiigh levels of cirlterion'- 
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related validity^ concurrent validity, test-retest reliability^ interrater 
reliability, Interscdrer reliability and intrarater reliability for use of 
the S/ELPS vlth Mexican American, Puerto Rican and Cuban children, preschool 
through third grade > 

Further review of the findings suggests that there is an apparent correla* 
"tlon between the number of children tested per day per examiner and the 
criterion-related validity coefficients at each site. (See Figure 2), It ' 
seemfit plausible that when examiners are required to test large numbers of 
children quickly, less valid results are obtained. It also seems likely that 
when examiners f.elt under a time pressure they spent less time £eStlng the^ 
students^ In addition, the examiners may not have conducted the testing in 
as thorough a manner as in test sites" where only a few children were tested. 
The primary implication is that testing should be conducted at a relayed 
pace , allowing at least 15 minutes per test administration. Testing of entire 
classrooms should be extended over a two to three day period, rather than 
attempting to test all children within a single day. Following these proce- 
dures should increase the probability of getting valid appraisals of the 
students' oral language abilities with the S/ELPS. Needless to say, thesd 
findings have implications for the administration of other tests to large 
numbers of children. 

Dissemination 

From the expanded testing made possible as part of the Ability Development 
Project, and by studies made possible by McGraw-Hill, the S/ELPS has been 
included on a list of tests recommended for use in Texas by the' Bilingual 
Division. of the Texas Education Agency. Additionally, the S/ELPS is presently 
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Figure 1 

Study C: 

— 

The relationship between criterion-related validity coefficients vs. 
nuniber of tests administered per examiner per day by test site. 



20.0- 



number of tests 
administered per 
ejcamlner per day 



l&.O 



12,0 



V 

8.0 



• Bethlehem 



4.0 



1.0 



.63 



• San Diego 



• Miami 



* Sar Antonio 



Yuma 



.73 



.83 
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being used ixt^ all kindergarten programs in the Edgewood Independent School 
District (San jtotonio, TexaQ)^ and Is being considered for use., in preschool 
progrs^ms in other cities. 

The S/eLPS became available for purchase in September > 1976. Through 
March, 1977 over i^OOO S/ELPS kits had been purchased. It has been pirojected 

1 

by HcGraw-HiU that more than 20,000 copies will be sold during the following 
year as availability information begins to reach more persons. Copies of 
recently prepared marketing and publicity Information are included in Appen- 
dix B. - , • 

Utilization of this product has ejctended far beyond the original target 
audience and is expected to increase even further as a result"^ of the recently 
completed studies with elementary age children from other Spanish-speaking 
backgrounds . 
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INSTRUCTIONAL MANUALS 

Early in the project, efforts were made to maximize usability of all pro- 

ducts^ to the greatest extent possible. Although this project was funded fcr 

deveiopment of materials for bilingual five-year-olds, their teachers ''and 

parents, it was also^felt that some products could be used with other ages 

and other groups. .The following four manuals xdiich were initially designed 

earlier fell into this category: 

♦ Worlcing with Parents of Handicapped Children 
• Trabajando con los padres de ninos con impedimentos 

• How to Till Your Toyshelves without Emptying Your Pocketbook 
• CSmo llenar sus estantes con juguetes Gin gastar mucho dinero 

An external consultant review also supported the use of these manuals with 
an extended audience. Therefore, permission was requested and received from 
USOE for release of the manuals to the Council for Exceptional .Children for 
publication. The manuals were published without copyright or royalty pay- 
ment to USOE, thus reducing the purchasing price. The manuals are, in essence, 
in the public domain and can be reproduced. At the same time, they are now 
available for purchase at a lower price than that for which they might be 
duplicated. A bri^ef description of the manuals follows. 

How to Fill Your Toy Shelves without Emptying Your PocketHook 

and 

C5mo llenar sus estantes con juguetes sin gastar macho dinero " ♦ 

Games, activities, and instructions for making manipulative learning 
equipment are included in these manuals. The equipment and activities have been 
designed to be used with handicapped and nonhandicapped young children in day 
care centers, classrooms, and at home. 

All items can be made from things which can be saved m the home, such as 
empty bottles and cans; from scraps, such as lumber and fabi^ics; from materials 
usually found in preschool centers or classrooms, such as blocks, beads, and 
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pegboards; or from things which can be purchased in variety stores. Instructions , 
for constructing several types of equipment, ranging from adult instructional 
aids, such as a felt board , to activities and games for children are included* 
All items are adaptable for small group or individual use. The equipment can 
be made by individual teachers, assistant teachers, and ^parents, or in a group 
workshop. 

All Instructions were tested by teachers and parents during a materials 
workshop. Directions for planning and conducting a similar materials workshop 
are detailed. Materials to be collected or purchased and' the necessary tools, 
and supplies are listed along with suggestions for arranging the workshop space 
into specific work areas. , 

Activities for using each item with children follow the' directiot^s for 
making equipment. Activities are. included for developing skills in the 
following areas: Visual, Auditory, Gross Motor, Fine Motor, and Language and 
Concept Development. 

Working with Parents of Handicapped Children 

and 

Trabajando con los padres de n'inbs con impedimentos 

Practical considerations and suggestions for working with parents of 
children with existing and/or- potentially handicapping conditions are the 
focus of this manual. Written for those who have had little or no formal 
training in working with parents of handicapped children, the manual is 
particularly useful for day care> Head Start, and elementary school teachers. 

Information on feelings and attitudes which may be encountered, specific 
suggestions on planning for meetings with parents, and guidelines for developing 
referral information and files are included. A "question and answer" format 
is followed in addressing critical situations and questions frequently asked 
by teachers and preschool staff. Major topics included are: Understanding 
How Parents Feel, Knowing Your Own Feelings, Meeting with Parents, and Following 
Up the Meeting. 

Sources from which teachers and parents may obtain additional information 
related to specific types of handicaps are provided in the appendices. Biblio- 
graphies include: General Information and Activities, Personal Narratives, 
and Suggested Readings on the Handicapped. In addition, sample forms and 
suggestions for conducting parent interviews are included. 



Initial reports of the sales of the English versions of the manuals 
has been quite rewarding. As of March 1976 (first quarter of publica- 
tion) the following quantities had been sold: 
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Title 



Worklng^With Parents of Handicapped Children . , 832 

Trabajando con los padres de ninos con impedimentos 28 

7 : • 

fiov To Fill Your Toy Shelves Without Emptying Your Pocketbook 1,058 
Como llenar sus estantes con juguetes sin gas tar mucho dinero 31 
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THE O^aSERViTIONAL CHECKLISTS FOR REFERRAL (OCR) * 

, The Observational Checkllscs^for Referral (OCR) was written as-a guide 
to help teachers and assistant teachers of young children identify possible 
problems, and make appropriate referrals to other professionals. The OCR 
includes a General Checklist to be completed for each child and Specific 
Chec^il'l^ts to be completed only for children identified on the General 
Checklist. Items on the General Checklliit were stated In broad terms to 
cover common physical or behavioral symptoms- of problems. Each item on the 
General Checklist related to one or more Specific Checklists representing the 
areas of Health, Vision^ Hearings Speech and Language^ Motor> Learning and 
Behavior. An accompanying manxial included instructions for completing each 
checklist and the problem area it is designed to identify as well as 
descriptions of the specific behaviors the teacher should note. ' 

The OCR was pilot tested by.,teaQhers and assistant teachers in Head 
Starts Day Care and public school kindergarten classes and was reviewed by a 
team of external consultants representing the fields of Speech Pathology, 
Audiology, Early Childhood, Special Education^ and Nursing to obtain formative 
feedback* Research was conducted to compare the effectiveness of teacher 
observation and identification with professional screening by project staff 
and external specialists (clinical child psychologist, educational diagnos- 
tician, speech pathologist, audiologist, pediatrician, optometrist, and nurse) 
A final report on tiie OCR which includes the results of this research, details 
on development of the OCR, and consultant reviews was submitted to BEH and 
entered into the ERIC System in the spring of 1977. (Evans, J. S. Observa- 
tional Checklists for Referral ; Technical Report . Project No. GO075OO592> 
Grant No. 443CH60398). 
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The following seciilon includes a summary of the research and development 
\ \\ \ ^ ' 

conducted, a report ofi ^ study conducted with parents, and recommendations 

for further development, < 

Instrument Overview and Development 

* Initial conceptualization and development of the OCR evolved\from the 
Project Director's previous experiences with students of elementary education' 
at the university level and with the need for giving future teachers the skills 
for identifying children in need of referral for more extensive evaluation. 

o 

With the initiation of a one-year project vith f our-yeaf-old Mexican American 
preschoolers, it became evident that day care teachers also needed a consistent 
and objective method of identifying problems of young children. As a part of 
this earlier project, the checklists were elaborated and tried out 'by day care 
staff. Teacher feedback and staff obseirvations .provided. additional information 
for initial design of an instructional manual. 

With the initiation of the current project, the checklists and manual 
were expanded for use as an identification instrument. This version included 
an instructional manual detailing instructions for completing each checklist, 
a general discussion of each problem area, descriptions of common behavioral 
manifestations of thos- problems, and guidelines for making and following up 
referrals. 

The revised version of the OCR was tested by teachers and assistant 
teachers in the Riverside Day Care Center, Austin, Texas, and by public 
school kindergarten teachers in the Edgewood Independent School District, 
San Antonio, Texas. A pilot validation study was conducted in Austin to 
determine the feasability of conducting a more extensive validation 
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study. The purpose of the study was to determine the number of oyer- and 
under-ref errals (false positives and false negatives) by comparing teacher- 
administered OCR results with screening evaluations by appropriate external 
specialists (speech pathologist, pediatrician, etc.). Table 5 summarizes 
the results of this study. These results indicated ttiat the usefulness of 
the OCR could be expanded for older and younger children. Formative data 
obtained during this study provided the basis for a revision of the manual 
and checklists. 

A second validation study was conducted at the A-Bar-Z Ponderosa Day 
Care Center in Austin during 1976. As in the first study, classroom teachers 
completed the checklists for each child, and external specialists conducted 
screenings for each area. Table g summarizes the results of chis second 
study. 

The results of these studies indicated a high rate of accurate identifica- 
tion and a low false negative rate (failure to identify existing problems.) 
The rate of false negatives ranged from 4.3% to 19.2% with the higher rates 
being for questionable problems such as umbilical hernia or possible muscle 
imbalance. of the eyes at an age when such balance is not stabilized. The 
positive responses by teachers and assistant ' teachers using the OCR, none 
of whom had previous training in identification of existing or potentially 
handicapping conditions, clearly indicated tlie usability of the OCR by 
the teachers of young children. As stated previously, details of these 
studies are available through ERIC. 

As a follow up to these studies, efforts were made to determine the 
feasability of using the OCR with parents. The, results of this study indicated 
that it was not only useful in parent identification of potential problems, 
but also served as a means of increasing communication between teachers and 



parents. 




Tabls 5 

Frequency and Percentage of Agreeipent/Nonagreement Between ipCR 

1975 Validity Study \ 

! ^ 1 



and Examiner Observations . 



CHECKLIST 


\ ■ 

OCR-POSITIVE \ 
\EXAMINER- ' 

No./% 


OCR-NEGATIVE 
EXAMINER- 

\ .No./%\ 


0 


1 

TOTAL ■ 
CR-EXAMNER 
AGREEMENT 
\ No./% 


1/ ' 

OCR-POSITIVE* 
EXAMrNER^ \ 

No./% \ 


\ 

OCR-NEGATIVE 
^EXAMINER- 

tJACTTTITt? 

Nol./% 


TOTAL 
OCR-EXAMINER 

No./% 


/ 

lUxiVL / 

No./Z / 




7 7l2.1% 

\ 


\ 37 /63.82 


4^ 775.9% ■ 


11 / 1 Q 02 \ 


3 /is 1^2 

i i 




i /■ 


Speech/Language 


12 /I6.2% 

*\ 


45 /60.8%\ 


57 ^7,0% 


8 /10,8% 


9 712. 1% 


17 /22.9% 


74 /1^0% 


Behavior 


13 /59.1% 


3 /13.6% 1 


16 /?^.7% 


1 / ^.6% 


5 /23.7% 


6 /28.3% 


22 /ioo|: 


Health 


6 1,18.8% 


18 /37.5% 


24 756^% 


4 /12.5% 


1(!^ /31.2% 


\ 

14/43.7% 


38 /IOOj! 


Vision 


0/0 1 % 


85 /97.7% 


85 /97.\^ 


0 / 0 % 


1 

2j / 2.3% 


2 / 2.3% 


8^ /100% 


Motor 


1 

0 / 0 ' % 

1 


61 /85.9% 


61 /85.9% 


,9 /12.7% 

1 


r- 

1 / 1.4% 


10 /14.1Z 


91 /100% 

/ 
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Table 6 

Frequency and Percentage of Agreement/Nonagreement Between OCR and Examiner Observations 

1976 Validity Study 



CHECKLIST 



CONFIRMED IDENTIFICATION 



OCR-POSITIVE 
EXAMINER- 
POSITIVE 
No./% 



OCR-NEGATIVE 
EXAMINER- 
NEGATIVE 
No./% 



TOTAL 
OCR-EXAMINER 
AGREEMENT 
No./% 



UNCONFIRMED IDENTIFICATION 



OCR-POSITIVE 
EXAMINER- 
NEGATIVE 
No./% 



OCR-NEGATIVE 
EXAMINER- 
POSITIVE 
No./% 



TOTAL 
OCR-EXAMINER 
NON-AGREEMENT 
No./X 



TOTAL 
No./X 



Hearing 



13 /71.8% 



66 /60.0% 



79 /71.8% 



25 /22.7% 



6 / 5.5% 



'31 /28.2% 



110 /100% 



Speech/Language 



14 /14.0% 



51 /51.0% 



65 /65.0% 



21 /21.0% 



14 /14.0% 



35 /35.0% 



100 /100% 



Behavior 



11 /23.9% 



16 /34.7% 



27 /53.6% 



17 /36.9% 



2 / 4.3% 



19 /41.2% 



46 /100% 



Health 



10 /12.2% 



27 /32.9% 



37 /45.1% 



35 /42.7% 



10 /12.2% 



'45 /54.9% 



82 /100% 



Vision 



8 /30.8% 



10 /38.6% 



18 /68.6% 



3 /II. 6% 



5 /19.2% 



8 /30.8% 



26 /100% 
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Teacher-^Parent Study 

Parents at the A-Bar-Z Ponderosa Day Care Center were Invited to meet 
with SEDL staff regarding use of the OCR, This invitation was extended via 
a- posted notice on the center bulletin board. Two meetings were held^ 
attended by 25 parents. During these sessions^ the purpose of the OCR was 
described and parents were asked to take the manual home^ read it> and com- 
plete the checklists for their children^ adding any comments they might have- 
Additional requests were received from parents who had not attended the meetings 
Therefore > a letter describing the purpose of the OCR was prepared and 25 sets 
^pf materials were left at the desk for parents to take home. A total of 45 sets 
were taken> of which eight were returned unmarked > 35 completed and returned^ 
and the remaining two disappeared. Of the 35 returned checklists » only 31 were 
used in this study.* Checklist results as completed by parents wer^corapared 
with checklists completed by teachers of these 31 children and with the ratings 
obtained by the specialists who had screened the children. 

The following figure shows the rate of agreement/disagreement between 
teacher^ and parents regarding children checked on one or more checklist items: 

TEACHER 



No 


Problems 


One or More 






Checked 


Areas Checked 




No Problems 








Checked 


8 


3 






(agree) 


(disagree) 




One or More 








Areas Checked 


3 


17 






(disagree) 


(agree) 





* Four children had withdrawn from the center for the summer months, and 
teacher checklists were not available for comparison purposes. 
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Of the children checked by the teacher as^having some type of problem 
but not checked by the parent, one child was identified as "shy" by the 
teacher, one child was identified on the Speech Checklist as:"speaking 
softly" and "speaking slowly" and one child was identified on the Speech 
Checklist items, "Talks like a younger child" and "Seldom talks*" As it ^ 
turned out, this child was three years eight months old, and had been moved 
into the.^our- to five-year-old class because of his physical size* 

Of the three children identified by parents but not identified by 
teachers, one child, was checked on the Behavior Checklist as wanting adult 
attention, one child was checked on the Hearing Checklist as saying "Huh?" 
frequently and wanting her own way, and the third child was identified by 
the parent as having frequent colds and allergies. 

Although these certainly are^at ^ major differences, there are some 
implications. The items checked by the teacher, but not by the parent, 
caused the teachers to reevaluate their per ceptioi^is. For example, the 
teacher of the four-year-olds class stated that she had forgotten that the 
child who "spoke like a younger child" was, in fact, younger than the others. 

The items checked by parents alerted the teachers to the need for a 
parent conference to see whether problems actually existed or whether the 
items, checked were simply typical behaviors for a child of that age. Even 
allergies and colds were important to the teachers. Evidence from several 
checklists on other children indicate that children in Austin, Texas have 
allergies and colds^ which, in some cases, affect behavior. 

Of the 17 children checked by both parents and teachers, all but one 
were checked on more than one checklist, (see Table 7 -) In addition, 
there was a gteat deal of agreement between teachers and parents on 
specific items. 



Table 7 



Comparison of Screenings, OCR, and follow-up 





PROFESSIONAL SCREENINGS 


OCR CH 


[ECKLISTS \ 


FOLLOW-UP 




NURSE 


AUDIOLOGIST 


'speech 


TEACHER 


PARENTS \ ^ 












Cklist 


Item 
Comment 


xceiu 

Ckllst Comment 




1 


Not tested 


4 

OK 


OK 


Hth 


Colds 
Allergy 


Bone cond. 
Hth Cold/ earah 


Observe 


2 


^0 resp. 


No resp. 


No resp. 


Hr .Lm : 
Sp Beh 


Hth Sp 

Ben uoids 


Ref. to 
uiag • uxxnxc 


3 


L« ear 

occluded 


• OK 


Short att. 
Poss* prob. 


Hr Mtr 
Sp Beh 




Hr Sp \ 
Den 1 


To 

UuOXOgxS L 


4 


Fluid 
pneiunonla 


OK \ , 


OK 


Hth 
Hr 


Colds 


Hth Hr Colds 

bp Ntr A3 ZiuaEi 


To - 
nospxcax 


5 


No resp. 


No resp. 


No resp* 


Hth Hr Vis 
Sp Beh Mtr 


Hth Vis Sp 
Hr Beh 


To 

£0/n 


6 


QK 


OK 


Not 
tested 


Hth Hr 
Sp Beh 


Colds 


Hr 'Sp 
Ben 


UDserve 


7 


OK 


Inconsistent 


Def. prob. 


Sp Beh 
Hr Vis 


Hth Hr Sp 

■Ben Mtr Garan 


To Sp/Hr 
oiinxc 


8 


Tubes 


OK 


OK 


Hth Hr 
Sp Beh 


Colds 
Eirah 


Hth Hr Tubes 
Sp Ben Uper* 


Observe 


9 


Not tested 


OK 


Slight 
Dysfluency' 


Mtr 


Hth Beh Allergy 
Mtr re tit Mai 


Observe 


10 


Not tested 


OK 


OK 


Sp Beh 


Hth Sp Colds 
Beh Earah 


Observe 


11 


Tubes 


Failed 
Both Ears 


Not 

Tested 


Hth Hr 
Sp Beh 


Colds 
Earah 


Hth Hr Allergy ' 
bp ooid iuDes 


To Sp/Hr • 
uixnxc 


12 


Tubes 


OK 


OK 


Hth 
Beh 


Colds 
Earah^ 


Hr" Aller-Colds 
Ben Ciaran«"iuDes 


UDScXvu 


13 


OK 


OK 


Poss . prob . 


Hth 


Colds 
Earah 


Hr. Ear 
Ben In tec t* 


UDserve ^ 


14 


OK 


OK 


Foss. prob. 


Vis 
Beh 


Vis 
Beh 


Observe 


15 


Not tested 


No resp. 


OK 


Beh 


bp 


To Sp/Hr , 
UiL xnxc 


16 


OK 


OK 


OK 


Beh 


Hr Beh 

Sp Earache 


Observe 


17- 




OK 


OK 


Hth Hr Sp 

Beh Mtr / 


.Hth 
^Beh 


Observe 
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The teacher and parent checklist responses were then compared with the 
results obtained by the specialists who had screened the children* Table 

11 includes a comparison of results from screenings by the pediatric nurse, 
audiologist, and speech therapist, as well as identification of areas checked 
by teachers and by parents and follow-up action taken. 

One fact was obvious from studying the checklists— colds, allergies, and 
.ear problems were noted by both teachers and parents quite frequently (in 

12 of the 17 cases). Fifteen of these 17 children were checked on the 
Hearing or Speech Checklist by either the teacher or. the parent* These 
children were also checked on the Behavior Checklist. However, only seven 
of the same children were identified by the audiologist or speech therapist. 
Obviously, all these children were not severely or eveti moderately handi- 
capped. Several of them "passed" professional screenings. 

The professional examiners based their ratings on seeing each child 
only one time for a specific purpose. They were not concerned with, nor had 
knowledge of, children who were* susceptible to frequent colds of allergies. 
Parents and' teachers were, however, aware of these problems. Colds are 
frequent among young children in the Austin area where the weather changes 
frequently and dramatically. Allergies are a major problem for many people, 

and colds and allergies often result in stopped up ears, earaches,, irritability, 

< 

and general fatigue. Young children are not as verbal as adults and are unable 
to clearly identify their problems. A child with a succession of colds, 
a-.lergies, temporary ear infections, and possible intermittent hearing loss 
(or at least a reduction in hearing sensitivity) may easily miss out on 
learning critical information. Furtner, the general feeling of listlessness 
or irritability may create problems of behavior. Therefore, frequently 
occuring colds and allergies should be considered an "ALERT" to teachers. 

i 



During those periods .of fime, young children may have difficulty attending 
dr learning. 

Several other "ALERTS" were, evident when comparing the teacher ^and parent 
checklist results, many of which were helpful to the adults and beneficial to 
the children. For example: 

Child No^ 1 had previously had an ear operation and was subject to frequent 
colds and earaches, although he parsed the auditory and hearing screening. 
The teacher's awareness of the previous hearing problem m?de her more aware 
of the need for speaking directly to the child and providing additional 
language experiences. 

Child No. 2 h ad obvious problems and did not respond to screening. The 
parent, however, had rejected the screening results. After using the OCR 
o and observing the child, the parent agreed to additional testing of the 
child at the Diagnostic and Evaluation Clinic. 

Child No. 3 passed the audiometric screening but had an occluded ear. 
Speech and Hearing as well as Behavior were concerns of both the parent 
and teacher. This child was referred to an otologist. 

Child No« 4 was an unexpe.cted case — the nurse identified pneumonia at the 
time of examination and the child was taken to a hospital* 
Child No. 5 also had obvious problems although the parent had previously 
rejected the possibility of any type of handicapping condition. After com- 
pleting the OCR, the parent stated her surprise at the number of problem 
areas and requested information on obtaining further evaluation. The child was 
entered into the Early Childhood Handicapped Unit of the Austin school district. 
In three cases, children had previously had ear operations (myringotomies) 
and tubes had been inserted. Although the teachers were aware of possible 
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hearing problems, they were not aware of the tubes and the children were 
going swimming each day. Communication between the parents and teachers and 
, consultations with the physicians resulted in two of the children being removed 
from swimming, possibly preventing further damage to the ears. 

The results of this study were not subjected to statistical analysis as 
the niimber of subjects involved was too small. In terms of individual chil- 
dren, the impact of this study was more important than achieving statistical 
sigaificance. Children in need were referred immediately. Parents and 
teachers had a common, objective basis for communication about the problems 
of individual children. And, it is assumed that in some cases this early 
identification reduced or eliminated problems which might have become handicaps. 
Although the OCR was useful for the purposes of this project and the 
response from teachers and parents has' been favorable, additional work is 
necessary before the OCR becomes available for general use. 

1. checklist items should be consolidated and reduced in number. At presenc 
the checklists are too burdensome for the average teacher. Items which 
are not used should be eliminated and the interrelationship between 
observations should be more clearly described. 

2. The instructional manual should be revised to include additional follow- 
up information, suggestions for classroom adaptation, greater emphasis 
upon parent-teacher communication, and recommendations for record keeping, 
and continuing use of the checklists. 

'■■3. Training is essential. Although there is no way of guaranteeing that 
teachers will read the instructional guide, planned training would 
increase usability and reduce misinterpretation of checklist items. 

4. Development of a parent component including a modified version of the 
checklists, manual and audio/visuals is essential. The importance of 
parent-teacher communication in the observation and referral of children 
is illustrated in the results of the preceeding study. 
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SUPPLEMENTARY MATERIALS 

The primary purpose of the Ability Development Program. for Five-Year- 

Olds ^as to design and develop Supplementary Materials which would enable 

/ 

the classroom teacher to work with the mild to moderately handicapped child 
who was mainstreamed within bilingual kindergarten classes. These materials 
were to be used In conjunction with the Bilingual Kindergarten Program (SEDL, 
1972) which is used across the nation in classes serving Spanish speaking 
five-year-olds and was adopted in 1974 by the State of Texas for public 
school use. 

For a child to meet the objectives of the lessons in the Bilingual 
Kindergarten Program .j[BlI?X he or she must acquire^ and utilize a complex 
array of skills • Although lessons in the BKP curriculum were designed in 
a developmental sequence, differences in children's ability to learn and 
the inclusion of a percentage of handicapped children in the preschool class- 
room created a need for activities and materials to augment the regular 
curriculum* Some children, because of disabilities which affect their 
ability to learn or becdiuse of experiential deficit s,yrequire extra assist- 
ance to learn. Therefore, the Supplementary Materials were designed to 
assist teachers who have no special education training and who must work 
with handicapped children within the regular classroom* 

Design tested and field tested under close supervision of SEDL staff, 
the Supplementary Materials were developed to augment the basic curriculum , 
by: 

1. Providing materials which could be used with handicapped children, 
in an integrated setting by teachers with varying levels of' 
competency; 

2. Providing alternative techniques, procedures and methods for 
simplifying instruction, analyzing the skill'^ and tasks required 
for performing an activity, identifying instructional needs and 
providing appropriate instruct ion ♦ 
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'3. Providing additional training for specific children in identified 
problem areas which would help them to progress within a main- 
stream classroom setting. 

The elements of the BKP selected for addition of supplementary infor- 
mation and activities were motor, visual, auditory and ideas and concepts. 
These areas include < perceptual-motor development, cognitive development and 
language developments However, information, techniques and procedures are 
also provided related to other areas such as social development and health, 

Description - of Supplementary >laterials 

The Supplementary Materials developed by the Ability Development Program 
were designed to be used by teachers, parents, and other adults. The materials 
were designed to be used in conjunction with the basic^ Bilingual Kindergarten 
Program (BKP). They were not designed to be used independently of the BKP. 
Through use of these materials, the teacher is helped to identify and better 
understand the child's problems. The materials supply the teacher with 
specific information on different types of problems, techniques and suggestions 
for adaptation of lessons, and provide remedial activities to give the child 
the extra assistance needed to progress with peers. 

The fl^nal version of the Supplementary Materials includes an Instructional 
Guide, Entry Level Checklists, a set of 5 x 8 Observation, Information, 
and Action Cards, Home Activities and Supplementary Media. Following is a . 
brief description of each of the materials. Samples of the Observation, 
Information and Action Cards appear at the end of tliis section. The Entry 
Level Checklists'^ instructions and samples of Home Activities, as well as 
samples of media are included in Appendix . 



6i 

51 



1, Instructional Guide - Use of the supplementary card f ile^ as well 
as background information on the development of the Supplementary 
^taterials is described. Also included are sections on methods of 
teaching the different components of tfie Bilingual Kindergarten 
Program , 

2, Entry Level Checklists - Provide an organized method of observation 
of the child's ability to function in the preschool setting^ as well 
as references to specific information on handling problems and class-** 
room management* See Appendix C for the Entry Level Checklists* 

- "3* Observation Cards - Designed to-be used with Visual^ Auditory^ Motor, 
and Ideas and Concepts lessons of the Bilingual Kindergarten Program , 
each Observation Card identifies specific behaviors to observe in 
each lesson, and some immediate remedial actions to be taken as 
well as references to Information and Action Cards and prerequisite 
lessons in the BKF, 

4. Information Cards - These cards provide information and suggestions 
on how to handle problems that may arise during the year. They are 
divided into two main sections: Daily Routines and Classroom Pro- 
blems. 

5. Action Cards - The Action Cards include a variety of ideas, techniques, 
suggestions and activities for teaching specific skills or tasks. 
Action Cards suggest: 

. alternate ways of teaching the same skill. 

. ^ays to simplify the task by eliminating stimuli or limiting 
the material. 

. a variety of ways that the child might practice the skill or 
task. 

. practical do*s and don*t*s from other teachers* 

6. Home Activities - A total of 36 activity sheets designed to be used 

by parents with their children as a supplement to classroom instruction 
in each of the following skill areas: visual, motor, auditory and 
ideas and concepts. See Appendix- D for instructions and samples of 
the Home Activities. ^ 

7. Media - Additional media depicting handicapped children and adults, 
which can be substituted, for existing media in the Bilingual 
Kindergarten Curriculum is included. See Appendix- E for sample of 

^media. 

Procedure 

The writing and testing of the Supplementary Materials were carried out 
in six phases: design, design testing with teachers and children, revision, 
field testing with teachers and children, 'and final revision. 



I Throughout the developmental process, the activities were subjected to 
constant review and A^itique by SEDL staff. In addition, experts in the .fields 
of psychology and- special education reviewed the materials prior to and following 
field testing. In the design test stage guidelines were developed for the writing 

\ 

of the Supplementary Materials. The following considerations were included: 

\ 1. The materials should provide the teacher with information, techniques. 
\ . and procedures for identifying, skills necessary for meeting curriculum 

\ objectives and for breaking down specific tasks into smaller, manageable 

<^ steps According to the individual needs of the children. 

2. ^ The materials should provide the teacher with information, techniques 

procedures and specific activities to be used in conjunction with the 
BKP in helping the handicapped child to progress with his or her peers. 

\ \ 

3. The matei;ials should relate to the following BKP components: Visual, 
Auditory,^ Motor , Ideas and Concepts. 

4. The materials should be designed to be used by teachers arid assistant 
teachers haying varying degrees of competency in working wit;h handi- 
capped children. 

5. The materials should be designed for use without special training, 
i.e., should be exportable and self-contained. 

6. The use of the materials should rBquire minimal preparation time. 

/. To incre'ase cost effectiveness, efforts should be made to use existing 
BKP media as much as possible. 

The remainder of this section describes the Supplementary Materials and 
the process of testing and revision in more detail. 

The Entry Level Checklist was based on a task analysis of the entry unit 
o,f the BKP. It was designed to serve as a diagnostic tool in identifying 
children unable to perform subsHiUs essential for learning and performing 
beginning level curriculum tasks and activities and to assess entry level 
social, self-help, and behavior during the first two weeks of school. The 
Entry Level Checklist is divided into two parts: Part I to be completed at 
\^ ' the end of the first week of school, and Part II to be completed at the end 
of the second week (10 days) of school. Following each checklist item is 
a reference to an Information Card which provides more detailed information 
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identi.fying^ problems and taking the necessary steps in remediation and/or 
rral. 

Part I incluJHj^ the following categories, each of which have sub-parts: 

Takes care of toileting needs independently 
2V Requires little or no assistance at mealtime 
3«\ Responds to and follows simple directions 

4. \ Interacts with adults and children 

5. \ Cooperates in teacher-directed groi p activities 

Part II includes the following categories, each of which have sub-parts: 
!• Follows daily routine with minimal difficulty 

2. .Beginning to initiate independent .activity / 

3. Changes activities easily and independently ' / 

4. Works independently at assigned group activity / 

5. ' Cooperates during group activity J 

\ These areas and the related sub-parts were identified by training staff 
and teachers as critical abilities for functioning in the kindergarten pro- 
gram» During the second year of the program, for example, eight out of the 
nine children in the experimental classes who were checked on three or more 
items (more than one item on both parts) on the Entry Level Checklist n^eeded 
supplementary instruction or assistance, 

Observation^ Information^ and Action Card design was based on an 
analysis of each lesson of the Auditory, Visual, Motor, and Ideas and Con- 
cepts elements of the BKP» During the first year, the objectives and con- 
tent of each lesson were analyzed to identify the subskills ivecessary for 
completing the tasks. In addition, teachers who had implemented the BK. during 
the previous year were interviewed to identify problem areas* Information 
obtained from the teachers was combined with the task analysis to determine 
activities necessary for developing prerequisite subskills. 

The first version consisted of Observation, Information and Activity 
Cards, written In both Spanish and English for each lesson of the BKP, 
During the design test period, the teachers implemented the supplementary 
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activities and feedback was provided to the project staff. The following 



types of Information were collected: 

- Nhlch tasks were difficult for the children? 

- Where did the skill break dc]wn? 

- After using the supplementaries , were the children able to complete 
. the task? 

FeeJback was also obtained on use of the Spanish and English versions 
of the materials and on the overall format and organization. 

First year feedback provided data for content and format revisions 

and for discontinuing the Spanish version during the second year. As a 

result of this feedback the following revisions were made: 

Observation Cards for the first unit (2 weeks) of the BKP were 
deleted and replaced by the Entry Level Checklist. 

2. The Information Cards were divided into two main sections: Dally 
Routine and Classroom Problems. The Daily Routine section included 
problems which could be observed during specific periods of the 
day, while the Classr^oom Problems section Included problems related 

, to specific areas: Behavior, Health, Hearing, Motor, Speech and 
Language and Other. Information on identifying and handling pro- 
blems, suggestions regarding classroom management, explanatory 
statements related to realistic expectations, as well as referral 
information were included. 

3. More '-emedial and reinforcement activities, suggestion and techniques 
for simplifying tasks. Information on pre-requisite lessons of the 
BKP. 

4. Based on teacher recommendations, the Spanish version was deleted. 
The teachers felt the English version was more useful since they 
had received their training in English. In addition, elimination 
of the Spanish version would reduce the u?.timate cost of the 
published materials. 

5. The coding system was revised for more efficient use. 

6. An Instructional Guide was added. 

During the second year field test cycle, verbal and written feedback 
were obtained. In addition to the experimental classroom teachers. 



seven teachers in San Diego ^ Texas and Philadelphia, Pennsylvania used the 
Supplementary Materials and provided written feedback* These data were 
collected on the overall usefulness of the Supplementary Materials rather 
than on a lesson by lesson basis* Teacher ratings of the Suppleiaentary 
Materials are tallied below* 



1. Overall, how useful have the Supplementary Materials been? 

-Extremely 

Not Useful Useful 





1 


2 


3 


4 


5 


a. 


Initial Checklists 


1 


3 


2 


4 


b. 


Observation Cards 


1 


3 


1 


6" 


c. 


Information Cards 


1 




5 


4 


d. 


Activity Cards 


2 


1 


2 


5 



2. Please rate the Supplementary Materials in terms of quality* 

' Poor Excellent 







1 


2 


3 


4 


5 


a. 


Initial Checklists 






3 


1 


5 


b. 


Observation Cards 






3 




7 


c. 


Information Cards 






2 


1 


6 


d. 


Activity Cards 






3 


1 


5 


e. 


Supplementary Media 






3 




5 



t 
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3. How easy or difficult has it been to use the Supplementary Materials? 







Difficult or confusing 
1 2 


3 


1 Very easy 
i 4 .5 




Initial Checklists 




2 





6 


b. 


Observation Cards 








8 


c. 


Information Cards 








6 


d.. 


Activity Cards , 








5 


e. 


Supplementary Media 






3 


3 



In ^additioii to rating the supplementaries^ the teachers provided responses 
to the following questions; 

1. On the average^ how many times during thf have you used thd 
Supplementary Materials and with hox^ many children. (Times) 

a* Observation Cards 
b* . Information Cards 
c. Activity Cards 

2. Should any parts (Initial Checklists^ Observation^ Information, 
Activity Cards) be omitted^ Which ones? 

3. What is your opinion of the general organization of the Supplementary 
Materials? Please list any suggestions for reorganization. 

4. What is your opinion of the fprmat of each part? Please describe 
any suggestions for change or particular strengths. 

a. Initial Checklists 

b. Observation Cards 

c. Information Cards 
Activity Cards 

5. What is your overall opinion of the Supplementary Materials as an 
addition to the Bilingual Kindergarten Program? 

6. Would you recommend the Supplementary Materials to other teachers 
of the Bilingualo Kindergarten Program? ^ Why? 

7. Do you feel the time spent using the Supplementary Materials aided 
your overall teaching? 
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-8/ In what ways did you use the Supplementary Materials? Please check. 
State the one way in which you used them most often. 

As remedial activiti^ for children who did not do the regular 
lessons 

As reinforcement activities for children. who needed more instruction^ 

As expansion activities to. add to the basic curriculum 

^ As alternate activities to substitute for the basic curriculum 

As additional activities for children who enrolled late ^ 

9. Please list any other comments or concerns. , ' 

X 

Comments and responses to the above questions appear in Appendix F. 

At the completion of the field test cycle, SpDL staff met with the 
experimental classroom teachers to obtain final recommendations for second 
.round revisions. Teachers were also asked at this time to submit written 
answers to the following questions^: ' • 

1. Should the Supplementary Materials be written in Spanish? 

2. After using the Supplementary Materials, what would you say to another 
teacher about using them? . * ' 

All answered "no" to the first question. Responses to the second question 
were as follows: 

"Gives good and additional ideas. Prefer activity suggested on back 
of observation cards, where teacher could flip over." 

"These are excellent in quality, depth and the insight you get. For 
a new teacher it must be like having a' consultant next to you at each 
step, helping and guiding you." 

"It may seem like extra work; but is highly useful and helpful." 

"I am an old teacher and .J:ill found it extremely useful. I wish I 
QOuld keep a set for my own personal use. Some things are so excellent 
tj[iat I wish I had the materials foreyer in personal use." 

Analysis of the formative data resulted in the following list of recommendations: 

1. Provide some sugb-. Jtions directly on the Observation Cards which 
would be implemented immediately in breaking down a task. 

2. Eliminate some of the cross referencing. 
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3. Add more activities* 

i 

4. Divide Observation cards by units 

9 

c 

. Completed revisions were reviewed by SEDL staff and an external consultant. 
A copy of the consultant's written report appears in Appendix G* Based ov 
the consultant's recommendation, the title of the Activity Cards was changed 

} 

to Action Cards because the Activity Cards include alternative teaching tech- 
'niques and methods as well as activities* 

The manual was revised to reflect changes in the cards and organization 
of the program* A section was added including a description of the Entry 
Level Checklist and suggestions for teaching the lessons in each of the four 
elements: Visual, Auditory, Motor and Ideas and Concepts* 

Although the above steps have been -described as discrete and sequential, 
in practice each was interroven so that many aspects of the process were 
c6nsidered simultaneously. For example, f<;edback on the Supplementary Materials 
for the first four units was incorporated into the design of the Supplementary 
Materials for the remaining units. 

The final version of the Supplementary Materials included 219 Observation 
Cards, one for every Visual, Auditory, Motor, and Ideas and Concepts Lesson 
in the Bilingual Kindergarten Program , lessons one through nine beginning with 
Day 11 (Chapter II, page 5)* The obs'ervations and activities for Unit 9 are 
designed to help the teacher pinpoint problem areas and provide repetit^'ion of 
previous lessons an^ other forms of remediation before "asking the child to 
combine skills or move on to readiness rxtivities* Supplementary Materials 
are not provided for the last three units as these imits were expansion acti- 
vities, designed to provide those, children who are ready with higher level 
reading readiness activities* Every observation on the. cards is followed by 




a reference number which tells the teacher which Action or Information Card to 
use for that particular problem* The card numbers appear on the top right 
hand comer and each number is prefixed by a letter which corresponds to the 
type of card. For example: 

0- 3 « Obseirvation Card Number 3 ^ 

1- 4 = Information Card Number 4 "... 
A-6 = Action Card Number 6 

In addition, many of the observations are followed by specific suggestions 
or ways to further break down a task at the time of the observation in order 
to further pinpoint the problem or to help the child achieve the objective* This 
information is written in small print following the observation. 

It should be noted, however, that the purpose of these suggestions is to 
provide the specific information on how to break down a task or make it simpler* 
The intention, therefore, is to develop the skill, not to completely break 
down each task. Consequently, once a particular t>pe of activity has been 
repeated several timest and the task broken down on several O.bservation Cards, 
the same information is not repeated for later lessons. Instead different 
types of tasks are broken down. For example, the skill of sorting occurs 
early in the curriculxim and on several Observation Cards. The teacher is 
directed to break down the task by reducing the number of pictures or objects, 
using objects or pictures which differ in one dimension only, etc. Many of 
the lessons beyond Unit 4 may involve sorting, but as part of a more complex 
task. Therefore, the task breakdown information beyond Unit 4 is related to 
the more complex task. It is expected that by this point the teacher will 
already be able to simplify the sorting task. 

A t5otal of 69 Information Cards provide information on identifying and 
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handling specific kinds of profeienxs, such as Behavior, Hearing, Health, 
Motor, Vision, Speech and Language; as well as when and how to make' 
appropriate referrals. References to organizations and other Information 
sources are also Included. \ 

There are 109 Action Cards, ^^each Including five or more techniques, 
suggestions and alternative activities for teaching a task and/or for 
practicing related sub-skills. \ 

The Observation, Information and Action Cards can be used without 
additional training by teachers or assistant teachers In conjunction with 
* the Bilingual Kindergarten Program . 

Home Activities were designed and written to be used at home by 
parents, as a supplement to classroom Instruction. The activities are 
divided into the same four skill areas as the classroom supplementarles: 
Visual, Motor, Aiidlnory and Ideas and Concepts. A total of 36 activity 
sheets for each of the four skill areas are Included. Each activity sheet 
Includes a minimum of five activities as well as Instructions for making 
and using a home-learning material. 

Due to time and recruitment problems, the Home Activities were not 
cycled through a complete developmental process. The activities wrlttet^ for 
the first five units were reviewed by a group of parents of handicapped 
children In the Austin Independent School District's Early Childhood 
Hand* -.anped Program. They were also used by some of the teachers In the 
same school setting. Although many of the parents had children with 
disabilities of greater severity than the group of children for whom the 
activities were Intended, the feedback obtained was relevant, as the 
objective was to determine clarity of Instructions, availability of sug-^ 
gested materials and ease of implementatlori. 



The majority of the activities were rated positively in all three 
categories, and the parents described the packages as valuable and very 
needed. Some minor wording changes were recommende^d as well as changes 
in suggested materials. - Tor example, some activities were added which 
require the use of garden, household or garage materials and tools. 
Teachers using these activities expressed enthusiasm regarding the" pos- 
sibilities of use in working with parents as well as use by new and 
inexperienced teachers and assistant teachers in working with handicapped • 
children. 

The Home Activities were revised and the format changed to include 
a feedback foCT which could be completed by the parent and returned to 
the teacher,' providing a means for the teacher to monitor the child's 
progress at home as well as the needs, and abilities of the parents in 
carrying out the Home Activities. 

The revised activities for all nine units were mailed to the same group 
of parents for review. Although the responses were very positive, as 
evidenced by the following comments, the total number of responses was 
limited. Also, not all activities were implemented. Comments made by parents 
included: 

"They have been helpful." 

"I trul-y see a need for activities for parents of handicapped 
children." 

"We had loads of fun completing them. Even my older son 
enjoyed helping." 

" The activities would have really helped me before, if I had 
this material when the two foster children came into my home. 
And I believe something in this kind of material should be 
available for all parents who have a handicapped child. 
Everything could be so much easier." 



"I would recommend, these activities to be available to all 
parents who need it and also to teachers who are involved 
with special needs children." 

In summary^ the Supplementary Materials of the Ability Development 
Program provide a means of identifying needs and individualizing instruc- 
tion for the handicapped child within the regular Bilingual Kindergarten 

o 

Program . The Supplementary Materials can be used by any teacher^ assistant 
teacher^ or team of teachers using the BKP. According to formative dat a, 
the Supplementary Materials are especially valuable to beginning teachers^ 
assistant teachers^ and teachers with little or no special education 
training who are teaching in mainstream settings. 
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SAMPLE OBSERVATION CARD 



K-2 Auditory (e) 
Rodv Awareness 
P. 174 

Environmental Sounds: Associating Body Sounds with Pictures 
Child is unable to: ^ 

1. Identify the sounds on the recording. See Card A-26 . 

Have the child observe you as you make the sound. 
Have the child imitate and say what she is doing, 

2. .Find the picture which shows the sound being made. See Card 

Have the child observe you as you make the sound. 
Point to the picture. 

3. Direct his attention to the task. See C(srd 1-3. 
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SAMPLE INFORMATION CABD 



DAILY ROUTINE: GROUP WORK j_3 

INATTENTIVE 

-For the child w ho, has difficulty paving attention to. the teadier 

1. Before school starts, decide on a method to get the children's attention. 
Different teachers prefer different methods; t^^ncion. 

a. Blink' ng the lights. 

b. Ringing a bell. 

c. Saying in a firm voice, "Boys and girls." ^ 

d. Standing up and raising your arm. 

2. From the very first the child: ,, must be taught that this is the signal 

for them to stop what they are doing and look at you. Practice this several 
times, and praise the children who stop their work and look up. 

3. Be sure that every time you ask for attention you have something important 
to say, and then say it quickly. Having children wait is asking for trouble 

» 

J*. Rathtr.than punishing those who are consistent violators, try rewarding 
those who pay attention promptly. Let them go outside first, be first 

line, or choose what they want to pla> with. You could also put their 
names on the hoard, or send a note home praising them. 

5. All teachers will have days when no one seems to listen. This is often a 
result of weather change or an activity that is too exciting. Keep calm 
tomorrow will be better. ' 
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SAMPLE ACTION CARD 



ACTION CARD * o A-26 

For the child who is unable to identify sounds c>i a recording 

Voices and environmental sounds often sound differently on a record or tape. 

!• The recording does not slow down or repeat itself. Step the recording manually 
after each sound, and identify it or have anotlier child identify it. Make , 
the same sound yourself, if possible. Talk about tlie sound (compare and contrast 
with other sounds). Then, proceed with %he activity as planned. 

2. If the child still has difficulty^ help her make a recording of familiar sounds. 
Stop the recording after each sound is made so tliat the child can see the dif- 
ferences between the original sound and the recording of that sound. 

3. If the child is not able to hear and identify differences in sounds; 

a. Begin with one sound. Have the child observe you making the sound. For 
example, liave the cliild watch you clap your hands, and lielp her identify 
the bo'dy parts used to make 'the sound. Then^^have the child turn around 

so that what you do cannot bo seen. Alternate the target sound with another 
very different sound, and have the child raise a hand or tell you everytime 
the target sound is lieard. 

b. Limit the number of sound objects used to two, and be sure that the sounds 
are grossly different at first. 

c. Give the child additional practice making sounds. 

1. have the child make these sounds after you: 

- tap fingers on table 

- stamp a foot 

- stamp ho til feet 

- clap hands 

- cough 

4. If the child has dlfEicuJty ciltendlng to recordings: 

a- Read the story or sing the song yourself. Wait to introduce the recorc'ed 

version when the child is very familiar with the song or story and attention 
span is longer. 

b. Let story time he an active rather than a totally passive time. 
' 1. Tell a story with actions 

2. Let the child supply the missing plirase 

3. Let the child pantomime movements 

4. Let a group join in on simple phrases 

5. Use costumes or props and let the group dramatize the story 
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ACTIOM CARD ° k-27 

For the child who is unable to associate sounds with pictures 

Association of sound with picture is an abstract concept, and many children will 
have problems. 

1." U a child has trouble matching sounds to their pictures, reduce the pictures and 
sounds to two, and be sure that the sounds are grossly different at first. 

•2. If the child has difficulty, divide the activity into fout different ones: 
a. Match the object to object , 
•b. Match the picture to real objects, one at a time, saying each time that 
the picture and object are the same ^ 

c. Match objects to their sounds 

d. Hatch the sounds, to their pictures. 

3. Show the child an object (ball, block, bell). Draw it as th. child observes. 
Then, let him match the drawing to the object. Kcpcat the same procedure 
for two or three objects. Then, mix the objects and pictures, beginning with 
two . 

4. If using a recording or tape of sounds causes problems, make the sounds yourself. 



CHAPTER III 



PILOT RESEARCH 



INTRODUCTION 

During Year Two of the Ability Development Project, pilot data were 
collected regarding use of the Supplementary Materials in the classroom and 

the associated utility of the Entry Level Checklist and the Observational 

J 

Checklists for Referral. These data came from three experimental and two 
control clfisses, having a total enrollment of 121 pupils. 

A continuing theme which pervaded the development of the supplementaries 
and the associated data collection effort reported here, was the belief 
that young children should not be diagnosed by only one instrument. 
Because of this, the supplementaries themselves thus contain ongoing diagnostic 
procedures; For the purposes of this study those children who received the 
most supplementary instruction were therefore identified as target children. 
For analytic purposes these target children were matched by age, sex and 
entry-test scores with pupils enrolled in the control classes. 

Results are reported following a review of study objectives and 
procedures in the next two sections. In order to view these findings from 
several perspectives, three different but complimentary strategies are employed. 
First, descriptive findings are given, including relevant information about, 
the schools, teachers and pupil groups involved. Next, statistical tests 
of significance are reported with regard to pupil achievement for the various 
groups. Finally, brief illustrative case studies are given. Summary discus- 
sions accompany each of these sections while suggestions for future research 
conclude the entire chapter. 
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PURPOSE/OBJECTIVES 

The primary objective cf this study was to obtain pilot data regarding 
the use of the supplementaries with Mexican American pupils who display 
learning problems in curriculum mastery. Other ADP-developed products are 
also included to study their relative usefulness for contributing to the 
identification of potentially handicapping conditions. 
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PROCEDURE 



Selection 



The selection process for the schools, teachers and pupils involved in 
the study is described below. 

Schodis and teachers . After presenting the research project to the Edge- 
wood Independent/school District Kindergarten and Elementary Supervisors, 
participating s;chools and teachers were selected. Two teachers were selecf.ed 
based on their !previous participation during the developmental stage of the 
project In Yeat One, Other participants were selected btsed on 1) lack of 
participation /in other special projects, 2) principal cooperation, 3) teacher 
cooperation, /and 4) compatability of the teachers with those already selected 
in terms of^ education and experience. In all, six teachers in five different 
schools w^e selected. Due to poor rev-zord keeping on the part of one teacher. 



only five 



classes at four schools are included in the final study, three 
experimental and two control classes. 

Pupils . Because the supplementaries themselves were designed to provide 
an ongoing diagnosis of curriculum mastery handicap, those ten pupils in each 
experimental class who received the most supplemental instruction as recorded 
by teachers were selected to comprise the target group. They were then matched 
with control pupils on the basis of age, sex, entry-normed reference percentiles 
(math and language), and entry-criterion-referenced test scores. Seven mean- 
ingful groups for descriptive and analytic purposes emerged: The total group, 
all experimental pupils, all control pupils, all target pupils, all non-target 
pupils, all experimental target pupils, and all control target pupils. 

Instrumentation/Data Collection 

Basic demographic information about the school district and the schools 
O 70 
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involved in the study was collecdted using the Texas School Universe Data 
Book (c. November^ 1976), Demographic data was also collected with respect 
to key teacher variables via a Questionnaire for Classroom Personnel completed 
at the beginning of the school year. Additionally > in March^ 1977 observational 
data were collected concerijing project teacher remediatio^ techniques. 

Main data collection focused on the pupils. Each instrument administered 
to pupils is now discussed in turn. 

Pupil demographic data . Classroom rosters > completed at the beginning 
*^ of the school year^ were used to provide "the following information on pupils: 
age> sex> ethnicity. 

Entry language dominance . The b/ELPS was administered to all pupils at 
the beginning of the school year to determine initial language dominance. 
Chapter II' of this report provides a full description of this ADP-developed . 
instrument . 

Observational Checklist for Referral . All teachers completed the OCR 
for their classes at the beginning of the year. Chapter II of this report 
provides a full description of this ADP-developed instrument. 

Teacher perception' of pupils . Two types of teacher perceiption data were 
collected. First, teachers were simply asked to identify chose pupils con- ^ 
sistently unable to master curriculum objectives. Second, teachers were asked 
to rate (1 low to 5 = high) the amount of remediation (control classes) or 
supplementaries (experimental classes) each child required for the first and 
second semesters of school. 

Pu pil attendance . Teachers tallied and reported the number of absences 
per semester for each child. 

Pupil referral data . Two types of informa'zion were collected regarding 

c 
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pupil referrals for asslstanceL outside the classroom* First, actual referrals 

made by teachers were Identified* Next, because actxial referrals were found 

<> : 

primarily to reflect the limited services available, at the end of the school 
* year teachers were also asked to nake their ideal referrals assuming for the 
moment othat all services were available. * 

ADP entry level checklist , (experimental classes only) The experimental 
teachers, as a part of their use of the supplementarles, completed the ADP- 
developed checklist 'for the first two weeks of school. These checklists . 
identified pupil problems related to readiness for instruction in the currl- 
culum and are also described in Chapter II* 

Use of supplementarles . (experimental classes only) The experimental 

1 teachers also recorded the number of observations, activities, and supplemen- 

( 

taries used with each child for each curriculum unit of instruction covered 
during the year, - . ' . *^ 

Criterion referenced tests of curriculum mastery . The BKP has an ac- 
companying set of criterion referenced tests (CRT) for each curriculum unit* 
Record of pupil performance on all CRT's administered was made available by 
classroom teacher? for analysis. This includes 14 tests: 1 pretest, 10 unit 
tests, and 3 mastery tests administered throughout the school year. It should 
be noted here that not alx teachers completed the entire curriculum during 
the year and data are incomplete past the second mastery test. 

Norm referenced tests of academic achievement . Results of district- 
administered norm referenced tests (NRT) for the project classrooms were 
made available for this study. Altho.ugh adminisJ:ered on a pre /post basis, 
two different tests were involved. The California Test of Basic Skills (CTBS) 
was administered to three classes and the Tests of Basic Experiences (TOBE) 
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wad administered to two classes* Review of both t\Bsts by th§ MS? staffs revealed 

» . 
that the tests neither resembled each other or the BKP curriculum lu terms of 

content* To make the best of the situation^ however » two decisions we^ 

made. Flrst^ the Pre-reading score of theXTBS was considered more comparable 

to the TOBE language test. Therefore^ 'these two scores and the two math sub- 

test scores were selected for ^^eceipt of statistical "treatmenc* Percentile 

^scores (for the JCTBS^ mld-klndergarten percentiles, and for the TOBE the 

, ^ ft , , 

only percentiles made available) were selected fdr use as the most convenient 
standard score available for common comparison* Second, because the BKP 
curriculum has Its own pre/post measure for the flrstj portion of the curriculxmi^ 
those two tests would also be treated Td.th the same analytic techniques usually 
accorded the normed referenced tests. Table 1 depicts' the data collection 
schedule employed. 

Data Analysis 

> 

Three different strategies ar^employed for reporting the information 
collected. ]?lrst> all relevant descriptive data are presented to provide an 
overview of the variables under consideration. Frequencies^ means^ ranges^ ^ 
and standard deviations are employed. Next^ statistical tests of significance 
are reported which address the issue of pupil differences. Chi square,\ 
analysis of variance^ and analysis of covariance are the statistical techniques 
used here. Finally, an illustrative case study approach is utilized to high- 
light some of the special issues which emerged during the conduct of the 
study. „ V . 
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Table 1 
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RESULTS 
Introduction 

The three types of reporting strategies selected — descriptive, statistical 
and case studies — are now presented in turn. At the » end of each section is 
a stnmnary discussion which highlights those findings or issues considered < 
most relevant. Recommendations for future research conclude this chapter. _ 

Descriptive Findings 

A primary question which^ emerged during the conduct of this study concerned 
the relative Impact o^: variables other than project curriculum and use .of 
supplementar*'.iis on pupil performance. First, do the results obtained reflect 
school systism resource differences, teacher differences, pupil differences 
or true effects of th<» curriculum for supplementary Instruction? This section 
will provide a review of the descriptive information collected about the 
schools, teachers and pupil groups included in the study and address their 
relative Impact on the statistical findings reported in the next section. 

Description of the district and participating schools . The Edgewood 
I.S.D. serves an area of primarily low income, urban Mexican American families 
on the west side of San Antonio, Texas. Over half of San Antonio population 
is Mexican American and a large percentage of this group lives in the Edgewood 
district. Because of its tax base, the district has faced severe financial 
problems. .It has also faced the problems caused by the cultural and language 
differences of the people. It is only in recent years that a combination of 
progressive leadership and government funding efforts have led to progress. 

The four schools involved in the project ranged in 'enrollment from 397 
to 796. Tvro of the campuses were quite old (built in the 1940's), with one 
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school moving to a new campus during the schoox year. The other two campuses 
were equivalent, both built In the late 1960's. ' The resources lavilable to 
the. classroom teachers varied but were generally minimal for dealing with 
handicapping conditions. Teacher reports indicated all schools had district '*-^ 
purses and Plan A resource teachers available. It was also reported, however^ 
that one of these resource teachers did not work with kindergarten pupils 
and another did not speak Spanish. Three schools reported having a part-time 
speech therapist, one of whom did pot speak Spanish. Two schools reported 
counselors, one of whom did not take kindergarten children. One school was 
reported as having migrant services and one was reported as haVing a psychiatrist 
one day a week who did not speak Spanish. ^ From thjs it can be seen that the 
outside resources available to this group of kindergarten teachers with pre-- 
dominately SpanJ sh-speaking pupils were limited. Although the extent to which 
this can account for the results obtained is undetermined, it seems obvious 
that in cases of handicapping conditions, student progress is affected by 
more than the addition of supplemental curriculum. 
Description of participating teachers . 

!• Background data. Table 2 contains a summary of the teacher back- 
ground data obtained through .completion of the Questionnaire for 
Classroom Personnel. All teachers had college degrees; cwo of 
the experimental teachers had master's degrees and one vas working 
on a master *s. All were certified for kindergarten and bilingual 
education. All but one experimental teacher were also certified 
for elementary teaching, and one experimencal teacher had a 
supervisory certificate. No teacher had certification in special 
education. The range of other grade levels taught was comparable 



Table 2 
Teacher Background Data 



1. Previous Academic Training 
' High School 



E 
3 



Other Tiraining 



M.A. Education 



2. Are you a Certified Teacher? 
No 



Yes 



For which level certified? 
Kindergarte n 



Elementary 



High School 



Bilingual Education 



Special Education 



Certificate in Supervision 



Working on M^A. in Bilingual/Bicultural Education 



M,A, Errly Childhood Education 



3. What other level or grade have you taught? 
None 



First 



Second 



Third 



Fourth 



4. Have 'you had previous experience in a bilingual Program? 
No 



Yes 



liov long? 0 



3* 



5. How long hava you used the SEDL Bilin^ual'^Kindergarten Program? 



1 year 

2 years 

3 years 



E = Experimental 
C = Control 
T = Total 
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between the two groups, ranging from kindergarten only to fourth 
grade. All had previous experience in bilingual program 
ranging from one to six years ^ with^the experiaen'^al teachers 
having more experience. All were comparable in terms of previous 
years of work with the SEDL Bilinnual Kindergarten Program . 

2. Differences observed in data monitoring. Several differences 
were noted among the teachers in terms of their completion of the 
OCR^ administration of the CRT, addition of supplemental dUrriculum> 
and knowledge and use of referral resources. Differences in the 
pattern of supplementary usage were alsc noted among experimental 
teachers. One ^eacher, for example, completed only four OCK^ while 
another completed 22. All teachers administered the CRT^s, 

but some tested one item at a time for the whole class while 
others administered the whole test to small groups. All teachers 
reported adding to the curriculum, but what was added varied 
depending on t-he curricula vith w^ich teachers were familiar. 
Knovfledge of referral sources varied as did actual referrals. 
One teacher made 3 referrals while another teacher mace 11. 
Finally, the percentages of pupils in the experimental classes 
receiving the supplementaries ranged from 81 per cent to 65 per 
cent to 59 per cent. The extent to which these observations 
reflect teacher differences or pupil differences cannot be 
determined, nor can the Resulting effect on the data be established. 

3. Observation of remediation techniques. On March 8, 1977, classroom 
observations weie conducted in all project classrooms for the 
purpose of identifying the methods teachers employed to work with 
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students unable to master lesson objectives* The teachers were 
observed for a minimum of one hour during which they worked 
with students on one lesson from Unit 9 of the BKP curriculum. 
Both the teachers and their aides were observed during this 
period. The observation categories and the frequency with which 
experimental and control teachers and aides were observed using 



each technique are found below: 

Experimental Control 

Remediation Technique Teachers (N-6) Teachers (N«4) , 

1« Repeat the task 13 

2. Break task into parts 17 0 

3. Go to earlier task 2 . 0 

4. Change language 8 ^ 2 

5. Put child through motions 3 4 

6. Ask another child to help 6 1 

7. Ignore failure 0 1 ^ 

8. Negative response 0 1 

9. Others 17 _3 

66 15 



Generally it was found that the experimental teachers used more 
, remediation techniques of greater variety than did the control 
teachers* 

Description of participating pupil groups . The Identification of target 
pupils in a manner useful to statistical analysis proved a difficult task 
given the variances described above and the small number of classeti involved. 
After much deliberation it was decided to identify those ten pupils in each of 
the experimental classes who received the most instruction using the supple- 
mentaries and match them with control pupils by age, sex and entry NRT and 
CRT scores. This decision was made because the use of the supplementaries 
was the major focus of the study and also provided the be st in dication of 
ongoing curriculum mastery handicap. It is realized, however, seven 
groups, emerged for potential contrast and analysis: The tof^al group, 
all experimental pupils, all control pupils, all target pupils, all 
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non-target pupils, all experimental target pupils and all control 
target pupils. 

While it is realized that this is by no means a traditional ^ 
definition of handicap, given the data available, this strategy 
operatioualized a definition which would provide sufficient numbers 
for statistical analysis. 

1. Demographic description. Tables 3 and 4 summarize the seven 
pupil groups by age and sex. Average age upon entering kinder- * 
garten for the total group was five years and five months (65months)i 
Although the experimental pupils were significantly older than 

the control pupils (p = .02) and non-target pupils were signi- 
ficantly older than target pupils (p « .006), there was no 
significant difference in the ages of the experimental target 
and control target pupils. Additionally, although there were 
generally more females than males, chi square analysis revealed 
no significant differences between any of the groups in terms of 
set ratio. With ci.e exception of five pupils in one of the 
experimental ^lasses, 100 per cent of the pupils were l^xican 
American. 

2. Entry language dominance. Table 5 depicts the percentage of 
pupils in each of the sample groups falling into each of the 
five S/ELPS categories. Chi square analysis of the number of 
pupils in S/ELPS category 1 (Spanish Dominant) versus the number 
of pupils in the other categories rovealed one significant 
difference; Target pupils were significantly rnqte often Spanish 
Dominant than non-target pupils. 

3. Observational ChecklibC for Referral. Because of the extreme 
variation in how teachers used the OCRs and the associated dif- 
ficulty in deterrairiirig whether the obtained data reflected teacher 
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Table 3 
Pupil Sex 









Males 


Females 




Sample 




N 


N 


% 


N 


% 


Significant Differences 



All Classes 



Total Group 


: 121 


57 


47.11 


64 


52.89 




iixx £iXperiineni.ax 


71 


36 


50.70 


35 


49.30 


E vs C: NS 


All Control 


50 


21 


42.00 


29-' 


58.00 




A±± largeus 


60 


26 


43.33 


34 


• 56.67 


i VS wi : No 


All Non Targets 


61 


31 


50.82 


30, 


49.18 






30 


13 


43.33 


17 


56.67 


Cii^ VS Uil iNb 


iargets 














All Control Targets 


30 


13 


43.33 


17 


56.67 






Superior Class Removed 


\ 


Total Group 


98 


48 


48.98 


50 


51.02 




Experimental 


71 


36 


50.70 


35 


49.30 
















E VS C: NS 


Control 




12 


^■4.44 


15 


55.56 




Targets 


47 


21 


44.68 


26 


55.32 
















T VS NT: NS 


Non Targets 


51 


27 


52.94 


24 


47.06 




Experimental Targets 


30 


13 


43.33 


17 


56.67 
















ET VS CT: NS 


Control Targets 


17 


8 


47.06 


9 


52.94 
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Table 4 
Pupil Age 



Sample 




1 X 


Range 


a 


Significant Differences 


All 


Classes 


Total Group 


121 


65.43 


60-72 


3.64 


E>C: p = .0169 


All Experimental 


71 


66.08 


60-72 


3.68 




All Control 


50 


64.50 


60-71 


3.41 


■ 


All Targets 


60 


64.52 


60-72 


3.54 


NT>T: p = .0059- 


All Non Targets 


61 


66.33 


60-72 


3.54 




All Experimental 
Targets 


30 


64.77 


60-72 


3.75 


ET vs CT: NS 


All Control Targets 


0 

30 


64.27 


60-71 


3.36 






/ 

Superior /Class Removed 




Total Group 


98 




60-72 


3.70 




All Experimental 


71 


66.0^ 


60-72 


3.68 


E>C:p = .0238 


All Control 


27 


64.22 


60-70 


3.47 




All Target 


47 


64.51 


60-72 


3.67 


NT>T: p = .0060 


All Non Target 


51 


66.55 


60-72 


3.49 




All Experimental 
Targets 


61 


66.33 


60-72 


3.54 


ET vs CT: NS 


All Control Targets 


17 


64.06 




3.60 






Table 5 

Pupil S/ELPS Scores: Entry Language Dominance 







1 


2 


3 


4 


5 




Sample 


N 


n 


% 


n 


% 


n 


% 


n 


% 


n 


% 


All Classes 


Total Group 


121 


64 


52.89 


19 


1-5 . 70 


17 


14.05 


9 


7.44 


12 


9.yz 


All Experimental 


71 


41 


57.75 


10 


14.08 


5 


7.04 


7 


9.86 


8 


11.27 


All Control 


50 


23 


46.00 


9 


18.00 


12 


"24.00 


2 


4.00 


4 


8:oo 


All Targets 


60 


41 


68.33 


10 


16.67 


3 


5.00 


1 


1.67 


5 


8.33 


All Non Target' 


61 


23 


37.70 


9 


14.75 


lA 


22.95 


8 


13.11 


7 


11.^8 


.All 'Experimental 
Targets 


30 


23 


76.67 


4 


13.33 


0 


0 


0 


0 


3 


10.00 


All Control Targets 


30 

i 


18 


60.00 


6 


20.00 


3 


10.00 


1 


3.33 


2 


6.67 


< 




Superior Class 


■Removed 














Total Group 


98 


52 


53.06 


17 


17.35 


•9 


9.18 


8 


8.16 


12 


12.24 


Experimental • 


71 


41 


57.75 


10 


14.08 


5 


7.04 


7 


9^86 


8 


11.27. 


Control 


27 


11 


40.74 


7 


25.93 


4 


14.81 


1 


3.70 


4 


14.81 


Target 


47 


33 


70.21 


8 


17.02 


1 


2.13 


0 


0 


5 


10.34 


Non Target 


51 


19 


37.25 


9 


17.65 




15.69 


8 


15.69 


7 


13.73 


Experimental Target 


30 


23 


76.67 


4 


13.33 


0 


0 


0 


0 


3 


10.00 


Control Target 


17 


10 


58.82 


4 


23.53 


1 


5.88 


0 


0 


2 


11.76 



Chi Square Analyses: 

(Number in Category 1 vs all other categories) 

1 = Spanish 

2 = Predominantly Spanish 

3 = Bilingual 

4 = Predominantly English 

5 = English y 



E vs C: .NS 
T>NT: p = .05 
ET vs CT: NS 
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differences or true pupil differences, the children in each class 
with the highest OCR scores were identified for analytic purposes, 
with a maximum number set at 10 per class. Chi square analysis 
revealed one significant difference:/ target pupils were more 
often those who received high OCR ratings (p « .005). Given 
that the OCRs were administered at the beginning of the school 
year and target pu|)ils were identified on the basis of later 
use of supplemental remediation, this provides support for the 
predictive validity of the OCR for the identification of handi- 
capping^ conditions. Table 6 provides the summary of this data. 
Teacher perception. Teachers were asked to rate pupils with 
respect to ability to master instructional objectives and the 
need for remediation/supplementation. Again, chi square analysis 
revealed significant differences only between ron-target and 
target pupils (p « .005). Table 7 contains this data. 
Referrals. Chi square comparison of those pupils who were referred 
during the school year with those who were not again revealed 
that target pupils were also thosa most often referred (p « .005). , 
"This is ='"*so true when teachers were asked to make their ideal 
referrals (p = .05). Table 8 is a summary of this data. 
Absences. Absence data was collected for all pupils on a semester 
basis. Analysis of variance revealed no significant differences 
between experimental and control, target and non-target,^ or experi- 
mental target and control target pupils. Table 9 is a summary 
of this data. 

ADP Entry Level Checklist. Ifaen those experimental / 



Table 6 

Observational Checklists for Referral (OCR) Data 







1 


2 








Sample 


N 


% 


N 


% 


£N 


Significant Differences 






All 


Classes 






Total Group 


35 


28.93 


86 


71.07 


121 




All Experimental 


, 25 


35.21 


46 


64.79 


71 




■ 












E vs Ct ^{S 


All Coiitrol ' 


10 


20.00 


40 


80.00 


50 


# 


All Targets 


26 


43.33 


34 


56.67 


60 
















T>NT: P-.005 


All Non Target 


9 


14.75 


52 


85. ,25 


61 


All Experimental 


17 


56.67 


13 


43.33 


30 


* 


Targets 


























ET vs CT: NS 


All Control Targets 


9' 


30.00 


21 


70.00 


30 




Superior C^ass Removed 


Total Group 


29 


29.59 


69 


70.41 


98 




Experimental 


25 


35.21 


46 


64.79 


71 
















E vs C: NS 


Control t 


4 


14.81 


23 


85.19 


27 




Target 


21 


44.68 


26 


55.32 


47 


T>NT: p=.05 


Non Target 


8 


15.69 


43 


84.31 


51 
















ET vs CT: NS 


Experimental Target 


17 


56.67 


13 


43.33 


30 




Control Target 


4 


23.53 


13 


Id. til 


17 

1 





1 = High OCR rating 

2 => Low OCR rating 
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Table 7 
Teacher Perception Data 





A 


B 


. Sample 


1 ^ 


2 


V 


1 


2 


N 


1 % 




I ' 




N 


% 


N 


% 


cN 










Total. Group 


21 


17.36 


100 


82.64 


121 


26 


21.49 


92 


?6.03 


L18 


All iExperimental 


13 


18.31 


58 


81.69 


71 


18 


25.35 


50 


70.42 


68 


All Control . 


8 

V 


16.00 


42 


8.4.00 


50 


8 


16.0.0 


42 


84.00 


50 


All Target 


19- 


31.67 


41 


68.33 


60 


22 


36.67- 


^8 


63.33 


'60 


All* Non Target 


2 „ 


3.28 


59 


96.72: 


^ 61 


4 


6.90 


54 


88.52 


58 


All Experimental 


12 


40.00 


18 


.60.00 


30 


15. 


50.00 


15 


50.00 


30 


Target 




















All Control Target 


7 


23.33 


23 


76.67 


30 


7 


23.33 


23 


76.67 


30 


0 


Superior 


Class Removed 


Total Group 


18 


18.37 


80 


81.63 


98 


21 


21.43 


74 


75.51 


95 


Experimental 


13 


18.31 


58 


81.69 


71 


18 


25 s 35 


50 


70.42 


68 


Control 


5 


18.52 


22 


81.48 


27 


3 


11.11 


24 


88.89 


27 


Target 


17 


36.17 


30 


63.83 


A 7 


18 


38.30 


29 


61.70 


47 


Non Target 


1 


1.96 


50 


98.04 


51 


3 


5.88 


45 


88.24 


58 


Experimental Target 


12 


40.00 


18 


60.00 


30 


15 


50.00 


15 


50.00 


30 


Control Target 


5 


29.41 


12 


70.59 


17 


3 


17.65 


14 


82.35 


17 



KEY ■ 

A ^ Unable, to Master 

instructional objectives 
B = Use of Remediation/Supplementation 
1 = Yes 2 = No 



Chi gnnare Analyses ' 

A B 

E vs C: NS NS 
T>NT: p=.005 p=.005 
ET vs CT: NS NS 



(Superior Class Removed) 



E vs C: ■ NS NS 
T> NT:. p=.005 p=.005 
ET vs CT: NS NS 
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Table 8 
Referral Data 







Real 


Ideal 


Sample 




1 


■ 2 


1 


2 






N 


1 . 


N 


% 


N 


1 % 


N 


1 2 








All 


Classes 










Total Group 




Zo 


^3 . 


93 


77 


38 


31 


83 


69 


All Exper. ' 

1 

All Control / 


71 


19 


26.76 


52 


73.24 


25 


35.21 


46 


64.79 


50 


9 


18.00 


41 


82.00 


13 


26.00' 


37 


74.00 


All Target 


60 


20 


33.33 


40 


66.67 


27 


45.00 


33 


55.00 


All Non Target 


61 


8 


13.11 


53 


86.89 


11 


18.03 


50 


81.97 


All Exper. Target 


30 


12 


40.00 


18 


60.00 


17 


56.67 


13 


43.33 


All Control Target 


30 


8 


26.67 


22 


73.33 


10 


33.33 


20 


66.67 






Superior Class 


Removed 








Total Group 




22 


22.45 


76 


77.55 


32 


32 65 




r — ^ 


All Exper. 


71 


i9 


26.76 


52 


73.24 


25 


35.21 


46 


64.79 


All Control 


27 


3 


11.11 


24 


88.89 


7 


25.93 


20 


74.07 


All target 


47 


15 


31.91 


32 


68.09 


22 


46.81 


25 


53.19 


All Non Target 


51 


7 


13.73 


44 


86.27 


10 


19.61 


41 


80.39 


All Exper. Target 


30 


12 


40.00 


18 


60.00 


17 


56.67 


13 


43.33 


All Control Target 


17 


3 


17.65 


14 


82.35 


5 


29.41 


12 


70.59 



Chi Square Analyses Key 

Real Ideal 1 = Referred 

E vs C NS NS 

T>NT p=.05 , p=.05 2 = Not Referred 

ET vs CT NS NS - - 
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Table 9 
Absence Data 





Semester 1 


Semester 


2 


Sample 


X 1 Range | o 


X 


1 Range 


1 0 


All Classes 


Total Groun 


5.99 


0 


- 57 


7.23 


7.46 






70 
i\J 


n OA 


.All Exper. 


6.97 


0 


- 57 


8.53 


8.90 


0 




70 


14.95 


Ail Control' 


4.60 


0 


- 25 


4.56 


5.42 


0 




26 


4.75 


All Target 


5.23 


0 


- 25 


5.10 


6.57 


0 




70 


9.50 


All Non Target 


6.74 


0 


- 57 


8.83 


8.34 


'0 


_ 


70 


13.9/ 


All Exper. Target 


5.07 


0 


- 17 


4.78 


6.70 


0 




70 


12.37 


All Control Target 


5.40 


0 


- 25 


5.48 


6.43 


0 


_ 


26 


5/53 

/ 




Superi 


or 


Class Removed 










Total Group 


6.65 


p 


- 57 


7.79 


8.35 


0 




70 


1 

13.07 


All Exper. 


6.97 


0 


- 57 


8.53 


8.90 


0 




70/ 


14.95 


All Control 


5.81 


0 


- 25 


5.42 


6.89 


0 




5.73 


All Target 


5.66 


0 


- 25 


5.41 


7.21 


0 




'70 


10.58 


All Non Target 


7.57 


0 


- 57 


9.43 


9.39 


0 




70 


15.04 


All Exper. Target 


5.07 


0 


-17 


4.78 


6.70 


0 




70 


12.37 


All Control Target 


6.71 


0 


- 25 


6.41 


8.12 


0 




26 


6.54 



/ 

NOTE: Analyses of variance procedures indicated no signifi- 
• cant differences between groups for /either semester. 




class pupils who received the highest scores on the EntxjL 



Level Checklist were compared with those who did' not, chi 
square analysis revealed no sigtiificanc differences. It 
Bhould be noted, however, that target pupils did have a ^ 
greater percentage of . pupils/receiving checks for the 

first two weeks of school tlian did non-target pupils. These 

/ 

data are found in Table 2j6» 



/ _ / 



Svpr^ary Discussion * Several issues merged in the course of . conducting 

/ ^ y 

this pilot research: the first focused on which variables /accounted most 



/ 

/ 



for the acadeaaic progress of handicapped pupils, and the, second on the methodo- 
logical issues involved when an^^ttempt Is made to research these variables. 
The descriptive information presented in this sectio^. will be discussed in 
light of each of these two is^iues. / 

The academic progress of handicapped pupils is obviously the product of 
mafiy forces, including resource availability and teacher and pupil variables 
as well as any curric^ulum or supplemental materials which may be used* The 
first of these forces Is addre^ssed in this section, i.e., what nutside resources 

* 4' f 

i I 

were available to the classrocm teachers ^ind subsequently to the pupils them- 

'/ 

selves* In the situation of a handicapped pupil, the addition of such outside 
assistance is probably a prerequisite for academic progress. Giveii that the 
outside resources available to all the classes in this study were minimal, the 
extent to which assistance provided by supplemental materials could be realized 
by any inaxvldual child is questionable, 

Next, although the teachers involved were quite similar in terms. of the 

demographic information presented, teacher differences observed in the course 
6f-data monitoring were considerable. How these differences at this point 

89 . 
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Table 10 • . 

ADP Entry Level Checklist 



1 

Sample 


Week #1 






Week if 


2 






1 


2 






2 




N 


% 


N 


% 


EN 


N 


% 


N 


X ■ 


All Exper. • 


71 


15 


21.13 


56 


78.87 


71 


15 


21.13 


56 


78.87 


Exper. Target 


30 


8 


26.67 


22 


73.33 


30 


9 


30.00 


21 


70.00 


Exper. Non Target 


41 


7 


17.07 


34 


82.93 


41. 


6 


14.63 


35 


85.37 



1 = Problem(s) Checked 

2 « No Problem(s) Ch.ecked 



NOTE: Chi square analysis revealed no significant between group 
differences for either week. 



/ 

/ 

/ 
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translated to the instructional level could only be conjecture. Certainly 
however^ tocher variables play a great part in whether or not the benefit 
of supplemental instruction can be realized by pupils. 



A final factor is the pupils themselves. In this study, descriptive 
data were presented which showed pupil comparability on a number of variables* 
The only significant difference found between experimental and control 



/ 



classes 'was that experimental class pupils were older. In comparison with 



nonr- target 



pupils, however, target pupils were more often Spanish Dominant, 
r'^ceived more checks on the OCR, were perceived by teachers as having difficulty 
with instructional objectives and needing remedial/supplemental assistance, 
and wete Lctually referred or the subject of ideal referrals. Although experi- 
mental target and control target pupils were matched in terms of age, sex,"^ — 

and entry NRX/CRT scores, and no significant chi square differences weve found 
between |:he twp group^ on any of the other variables, it should be noted that 
experimental target pupils had higher percentages on all thjs other variables 
associated with the target group. Experimental target pupils, in contrast with 
control target pupils (1) were Spanish Dominant (77 per cent versus 60 per cent), 
(2) rec|eived higher scores on the OCR (57 pa^ cent versus 30 per cent), <3) 
wer.e mbre of ten. per calved by teachers as unable to master instructional objectives 
(40 per cent versus 23 per cent) or in need of remediation/supplementation (50 
per cent versus 23 ^er cent), (4) were more often referred (40 per cent versus 
27 peJ cent) or suggested for ideal referral (57 per cent- versus 33 per cent). 
Given! the amount of literature available today which discusses the extreme 
variability among handicapped pupils and the potential inappropr lateness of 
statj/stical analyses, it could well be that the pupils in the experimental 

I 

target group were, in fact, pupils with greater handicap. Although this was 



not indicated at the beginning of ^ the year on the NRT and CRT J. differences 
were observed on .all the othe? variables associated with being la target child. 
All of these considerations have tremendous Impact at the methodological. 



leyel. For eicaxuple^ although every effort /was made to select s 
si|:uations^ and comparable instructional personnel^ adequate ac 



Imilar school 
ountabiiity 



and control for these two vital factors were probably not sufficient given 
thej small sample size involved in this pijot data collection. Tie lack of 
outside resources could overshadow any subsequent effects of the! supplementaries/ 
as could teacher variability. Additionally^ although experimental target and 
control target pupils were matched in teiLs of age^ sex^ and entry scores^ 
there are other indicators present that the experimenf.al target pupils may. 



in fftct, have been pupils with greater ^cademic handicap. Again, given the 
small numbers involved in this study, true effects of the supplementaries coiifd 
be obscured. 



Statistical Findings 

/ 

Introduction . Analysis of variancfe and covariance were performed comparing 

f T . ' ■ : - ; 

experimental and control, target and non-target, and experimental target and 
control target pupils in terms of NRTj language and NRT math. Due to coding' 



and programming, incompatibility, CRT jinformation could not be used in thesfe 

1^1 7 

Analyses. Initial comparability, gains within groups, relative difference's 
l±n gains, and final comparability anj'ong groups were explored. After thesj 
analyses were performed, results indicated one control class with superic^i 
pevformance. A second set of analyses were performed omitting this clasii. 
The results of both sets of analyses are reported, followed by a summarv dis- 
cussion. / 



o 



Kesults; all' classes ♦ 

1. Initial comparability. Three significant between-group differences 

r 

.were found at project entry: non-target pupils were significantly 
higher than target pupils in terms of NRT language and math per** 
cettt^les and experimental pupils were significantly higher than 
^ control pupils on NRT math. 

2. Within-group gains. All groups made significant gains in achieve- 
ment as measured by the NRT language and math tests. . ^ 

3. Final comparability. At" project end, non-target pupils continued 
to be significantly higher than target puiiils on the NRT language 
test but not on the NRT math test. Control pupils were signif i- 
cantly higher than experimental pupils >on exit NRT math and control 
target pupils were significantly higher than experimental target 
pupils on both language and math exit NRT. 

4. Comparisons of gains. Analysis of covariance procedures indicated 
that both contral and control target, pupils made significantly 
greater gains than either experimental or experimental target 
pupils on both NRT language and NRT math. 

A summary of this data is found in Tables 11 and 12. 

As mentioned previously, inspection of this data revealed that one control ' 



class inade superior gains in comparison to all the other classes. All descriptive 
data and tests of statisti( al significance were thus performed again, omitting 
this class. This information will now be reported. 
Results: superior class removed . 

\ ^1. Descriptive information. Omitting the class which displayed 

superior gains did not change any of the relationships previously 
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Table 11 



Norm Referenced Test Data: 
All Classes 



Sample 


Language 


.' Math 


N 


X 


Range 


a 


N 


X 


Range 


a 


« 

Total Group 


* 




















- 






e.nt'ry 


98 


10.92 


1 




66 


12.71 


110 


18".42 


1 


- 


96/ 


22.54 




extt 

* 


101 


45.00 . 


1 




99. 


27.33 


107 


50.43 


1 


*• 


99 


32\51 


All 


Exper . 




























entry 


58 


11.74 


1 




66 


13.32 


62 


22.94 


1 


- 


96 






exit 


59 


42.03 


1 




27.08 


6.1 


42.52 


1 


— 


99 


29.60 


All 


Control 












■ 
















entry 


40 


9.72 


1 




.41 


il.83 


48 


12.58 


1 


- 


67 


15.57 




. exit 


42 


49.17 


2 




96 


2 7. "45 


46 


60.91 


3 


— 


99, 


33.53 


All 


Target 




























entry 


47 


6.94 


1 




45 


9.91 


57 


12.51 


1 




67 


15.74. 




exit 


53 


34.98 


1 




93 


27.27 


57 


45.46 


1 




99 


35.53 


All 


Non Target 




























ent7:y 


51 


14.59 


1 




66 


13.94 


53 


24.77 


1 




96 


26.80 




exit 


48 


56.06 


7 




99 


22.98 


50 


56.10 


8 




99 


27.96 


All 


Exper. Target 




























entry 


24 


7.92 


1 




45 


11.17 


27 


14.56 


1 




60 


16.44 




exit 


27 


26.56 


1 




74 


22.69 


28 


32.04 


1 




93 


31.00 


All 


Control Target 




























entry 


23 


5.91 


1 




36 


8.52 


30 


10.67 


1 




67 


15.13 




exit 


26 


43.73 


2 




93 


29.25 


29 


58.41 


3 




99 


35.27 



Table 12 

Norm Referenced Test Data Analysis Summary 



A. Between Group Differences 



Analysis | Sublect 


E vs C 


1 T vs NT 1 ET vs CT 


Al] 


. Classes 






NS 


+NT:p-.0028 


no 


3 


Math 


+E:p=.0154 


+NT:p«.0042 


■NS 


r^usLi-eoL uixxerences 


jL»an^uage 


NS 


+NT:p=,0002 


•n*i.p=«.0i93 




'Math 


+C:p=.0037 


NS 


+CT:p=.0044 


Gains Differences 


Language 


-K::p=.0434 




+CT:p».0089 




Math 


-K::p=.6045 




■tCT:p».0098 




Superior 


Class Removed 




Pretest Differences 


Language 


NS 


+NT:p=».0089 


NS 




Math 


NS 


+NT:p=.0049 


NS 


Post test Differences 


Language 


NS 


+NT:p-.0000 


NS 




Math 


NS 


+NT:p=.6099 


KS 


Gains"" Differences 


Language 


NS 




NS 




Math 

r 


NS 




NS 



\ 

B. Within Group Gains 



Subiect 


Total 


Experimental 


Control 


Experimental 
Target 


Control 
Target 






All Classes 






Language 
Math 


.0000 
.OOOU 


.0000 
.0001 ^ 


.0000 
.0000 


.0001 
.0391 


.0000 . 
.0000 . 


Superior Class Removed 


Language 
Math 


.0000 
.0000 


' \ .0000 
^ -.0001 


.0000 
.0000 


.0001 
.0391 


.0002 
.0002 
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reported in the descriptive finding' section of this chapter. 
There wao still no significant betwleen-group differences in terms 
of sex ratia*^ Experimental pupils continued to be older than 

control pupils (p « .02) and target pupils significantly older 

i 

than non-target pupils. (p » .OOS).^ Again target pupils (1) were 
significantly more often Spanish Dominant, (2) received higher 
ratings on the OCR, (3) were perceived by teachers as unable to 
master instructional objectives and in need of remediation/, 
supplementation,^ (4) were more often the subject of real or ideal 
^ . ref6^rrals..__jrhere were. no_dif f ierences among any groups with respect 
to absences* Additionally, although none of the analyses again 
reached significance, experimental target pupils had higher per- 
centages displaying target pupil characteristics than did control 
target pupils, indicating that this group could possibly have 
greater handicaps. Svimmaries of these descriptive findings are 
found in Tables 3-9. 

2. Initial comparability. Analysis of variance of entry NRT language 
and math percentiles revealed one significant difference: 'non- 
target pupils were significantly higher than target pupils. 

3. Within-group gains. -All groups made significant gains in achieve- 
ment on both NRT language and math tests. 

4. Final comparability. At project end, the only significant dif- 
ference between groups was again significantly higher -language 

* "'and math scores obtained by non- target pupils when compared with 
target pupils. ^ 

5. Comparison of gains. Kftf- significant differences between relative 
gains were identified by analysis of . covariance procedures. 

Tables 12 and 13 contain a summary of these data. 

96 



Table 13- 



Nor© Refeienced Test Data: 
Superior Class Removed 

0 



1 


Language 


Math 


Sample 


N 


X 


Range 


a 


N 


X 


Ranee 




Total Group 
entry 
exit 


79 
-.86 


12.11 
41.56 


1-66 
■1-99 


13.5Q> 
25.83 


88 
88 


21.70 
43.00 


1 - 

1 


96 
99 


23 97 
28.75 


Exper. 

entry 
exit 


58 
59 


11.74 
42.03 


1-66 
1-99 


13.32 
27.08 


62 
61 


22.94 
42.52 


1 - 
1- 


96 
99 


25 9'i 

• yj 

29.60 


Control 

entry 
exit 


21 
27 


13.14 
40.52 


1- 41 

2- 80 


14.27 
23.31 


26 
27 


18.77 
44.07 


1 - 
3 - 


67 
96 


18 5"? 
27.75 


Target 

entry 
exit 


36 
till 


7.83 


1-45 


10.97 

99 AO 


44 

A*; 


14.59 


X 

1 


0/ 

93- 


17.22 
29.69 


Won Target 
antry 
exit 


43 
4.2 


15.70 
5.4.69 


1-66 
7-99 


14.47 
22.53 


44 
43 


28.82 
50.98 


1 - 

8 - 


96 
99 


/ 

27.61 
25.72 


Exper. Target 
entry 
exit 


27 


7.92 
26.56 


1-45 
1-74 


11.17 
22.69 


27 
2^ 


14.56 
32.04 


1 - 
1 - 


60 
93 


16.44 
31.00 


Control Target 
enf^y 
exit 


12 
17 


7.67 
32.94 


1- 36 

2- 63 


11.04 
22.28 


17 
17 


' .65 
J. 88 


1 -r 

3 - 


67 
89 


18.90 
27.40 



Table 14 
Missing Data 



Test 



Entry Language 

,Bxlt Language 

N Omitted for Covariance - 
I^anguage 

L Entry Math 

• " Exit Math 

N Omitted for Covariance - 
Hath 



Control Classes 
1(N«27) 2(N-:'23) 



6 
1 
0 



8 

11 
1 
A 



Experimental Clas^ies Total 
3(S='2l) 4(N«23) 5(k»27) | (N-121) 



4 
0 
3 



6 ' • ■ 
2 ^ 
4 



13 
7 
3 



20 

40 
11 
14 

24 



Smnmary Dlscussldn 

. Four methodological issues warrant discussion with respect to the 
statistical analysis reported above> two^'which relate specif ically to this 
section and two which were mentioned previously and should be underscored 
here» • ^ • 

For the data presented in this section^ two methodological problems, 
were present which had an effect on the results obtained* Firsts as shown 
in Table 14 > there was a definite problem with missing' data. Scores were 
missing for roughly 1/3 of the pupils on the language NRT and 1/5 of the 
p'upils. on the math NRT. Given _ the small number of pupils involved in the 
study> this loss of data is most unfortunate.' Second^ the use of two 
different NRT tests,, both.of which we?e rated as unrelated to the curriculuoi 
and to each other, undoubtedly added an unaccountable variance to the data 
and subsequent analysis Both of these Issues reduce confidence in the 
results obtained and have important implications for future resear^ which 
will be discussed, at the end of this chapter. 

Two issues mentioned previously, teacher and pupil differences, should 
be referenced again here. Because of the statistical results obtained which 
incficated wide differences in pupil performance gained by class i each class 
was considered separately and compared with every other class using analysis 

of covariance. Two classes, one experimental and one control, showed 

< 

consistently greater gains than the others while one experimental class 
consistently showed the least gain. T)iese diff erences , -whether due to 
teacher or pupil differences, certainly obscured any measurement of the 
effectiveness of the Supplementaries. ^ 

Although the selection criteria employed was chosen because of its 
expected statistical utility, the methodological problems discussed here and 




in the sectioiiL providing descriptive results have diminished the confidence 
that can be placed in the statistical ^.findings of this pilot research. . 
Therefore » in an effort to indicate some of the benefit of using the supp^e- 
mentaries not revealed through the analyses > the few children in .the three 
experimental and remaining control class who would be defined las handicapped 
by the traditional state or school district criteria and their progress is 



now) briefly described. ■ ^ . - ' ^ ' j / 

Of the 30 target children in the experimental ■ classes Qi.*e.» thj^ ten 

children in each class who received the most supplementary Instruction as 

• ^ / 
recorded) » six children were referred for speech therapy. / Five children 

were enrolled in speech therapy »and one placed on a waiting list. Each of 

these children were examined by a" schoit>^ .district quali^ed therapist* Four 

children were referred for medical examination and one jtox psychological 

I ..If 
evaluation and received assistance of some type (e.g. Masses > ear operation) 

Thus> of the 30 "target" children identified for statistical a^nalyses, 11 

had a traditionally identifiable handicapping condition which interferred 

with leading. Of the <:ontrol class pupils, two children qualified as 

speech handicapped; no other referrals were made. /Whether the experimental 

classes actually enrolled more handicapped pupils/ or the experimental 

I ^ 

teachers were more sensitive to the identification of handicaps cannot be 
ascertained. Yet this certainly has affected t|ie statistical analyses 
previously reported. 

Table 15 shows these traditionally defined handicapped children by 
referral /handicap, NRT language and math percentiles and gains. For 
experimental class pupils, the number of supplementaries received is also 
shown. Although the problems or insufficient and missing data is again 
revealed, pupil gains are shown for these traditionally defined handicapped 



ERIC 



O ., » ' 100 



. . . Table 15 , * 

Traditionally Defined Handicapped Pupils: Descriptive .Information 



NRT Percentiles Nunbcr of 

Class/Child Referral/Handicap Language Math Siqiplementaries 







Pre 


Post 


Gain 


Pre 


Post 


Gain 


^ 


Ex 1-13 


Speech (not served) 


13 


8 


-5 


1 




^21 


30 


Ex 1-15 


Speech 


5' 


59 


+54 


1 


.35 


+34 




Ex 1-17 


' Speech 


2 


32 


+30 


15 


93 


+78 


83 


Ex 1-18 


Medical (neurologici 


il 










- 






vision, speech) 


7 


- 

13 


+6 


1 


.12 


+11 , 


28 . 


Ex 2—7 


Speech 


2 


1 


-1 


• 24 


2 


-22 


26 

V 


Ex 2-15 




2 






"> 






Jo 

« » 


Ex 2-16 


Speech ? 


3 


13 , 


+10 . 


2 


9 


. +7 


25 


Ex 3-5 


Medical (hearing) 


5- . 


10 


+5 


43 


1 


-42 


2 


Ex 3-12 


Medical (hearing) 




3 




1 


■ 1 


0 


8 ' ; 


Ex 3-ir 


Psycliologist 
• 








11 


8 


-3 


6 


Ex 3-26 


Medical (vision) 


40 






51 


51 


0 




Control-15 


Speech 


, 4 


40 


+36 


8 


43 


+35 




Control-22 


Speech 




2 




5 


13 


+8 





r 
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pupils incclasses using the supplementaries. 

Other Issues Identified during the course of data collection remain 

■ ■■ J. 

to be presented. Therefor^, the next section<of this chapter Is composed 
of a JEeir case studies yhich provide a fuller picture of project Issues and 
findings. Suggestions for future research complete this chapter* 



Case /Studies 



Individual ycase studies often bring to flight criticaL aspects of a 
^search situation which may not be evident when only niaoerical descriptors 
nd-«ta4JLs.tlcal tests of significance are employed. They particularly serve 



to indicate the complexity involved in the situation' under study > in this 
case^ the influence of a supplementary curriculum on the academic progress 
of low income, Spanish-speaking, mains treamed, kindergarten pupilis enrolled 
in classes taught by teachers of varying backgrounds in ability, in a school 
district/ which generally has poor facilities and minimal resources. 

len traditional resources fail * One point made in this report has been 
that few resources' were available to pupils in this study and that many 
handicapping situations hava prerequisite resource needs before supplemental 
curriculum could be of help. The importance of the quality of the resources 

used to help a handicapped child was also highlighted in the case of Maggie. A 

>anish dominant "child identified on the OCR as having problems in the areas 

' r 

of hearing and speech ^nd language, Maggie had low entry NRT and CRT scores. 
Her classroom teacher worked with her very cooperative mother who. took the 
child to a doctor. The doctor recommended no treatment saying nothing was 
wrong. By the end of the year however, Maggie had suffered permanent hearing 
loss due to nerve damage, identified by a second physician. Some supplemental 



Instruction was used throughout the year; the teacher worked with the child 

to> have her communicate when hearing problems arose ^ and worked with the other 

• . / • . - 

children understand the problem; the mother was cooperative and took the 

/ • V , 

child to the doctor. However, the child's academic progress was mlxiimal> 

/ 

perhaps overshadowed, by t^fe increase in her hearing problem. Therefore, it 
can be seen that' not onl^ availability but quality of resources is an important 
contributor to the academic progre^'s^^of- the handicapped. 

When family sltua^tlons contribute to problems . Although not discussed 
previously, certainly family variables must contribute to student progress. 
Ray, another Spanish dominant child, began the year with' a variety of problems 
-identlfied-by the~:teacher on the OCR and low NRT and 'CRT scores ^ He also 



received supplemental instruction during the year, but no NRT $aln was noted 

by the end of t^/e year. During the year, the teacher discovered that this 

/ ^ ' ^ 

.child was being abused by a step-parent. Although reported to the* family 

social, worker , no action had been taken at ithe time of the teacher's last 
report in May. In fact, other children in ; the family covered up the situation. 

In otlier cases, the teacher's work with family members resulted in reducing 
the problems of some children. . The point here is that information regarding 
family situations may be an important variable to consider when researching 
pupil progress. 

The creative use of resources . Frank, a predominately Spanish-speaking 
» child, was listed on the OCR as having both sjpeech/ language and motor problems. 
He had low entry NRT scores but performed at the class norm entry CRT. In 
addition to the use of supplementaries, the teacher referred this child to a 
speech therapist. The therapist f elt ,that his problems were maturational and 
would be outgrown. Knowing the teaching styles of the probable first grade 
teachers this child might be placed wi.h the next year, the teacher also referred 



Frank to a counselor. The counselor made recommendations about best teaching 
» strategies and backed the teacher in recommending that the cl^ild be placed In 
a particular class the following year. Thus, the teacher used the outside' 

resource to get support for future child placement. Although relative gains 

1 

made by this child were not outstanding during this academic year, the course 
set by allowing him to be placed in the best possible learning context for 
the next year/'ls expected to be quite beneficial. This case not only illtistrateis 
the use of resources but alco points up the need for longitudiiial research. 
Often the positive benefits of teacher efforts or .supplemental instruction * , 
may not be apparent during one school year. . . » 

These brief case studies have served to continue to highlight -the com^ 
plexlty .of the research situation under question. In the next sectipn of this 
chapter,^ SI the^variables discussed are synthesized and recommendations for 
future research are madfc. ^^^--^-l 
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RECOMMENDATIONS FOR FUXURE RESi 

i ■ : 

I • 

'] On the basis of the positive f onnatsWe input received (s)ee App«idix F) , 

'and the gains shown for several of the tradrtionally defined handicapped , 

I ■ ' / \ ' 

pupils who received supplensntal instruction (seK Table vl5) > it is believed ' 

that the supplementaries may be beneficial for use by^ttie bS^J^ingual kindergarten ' 
classrdom teacher working with mild to moderate handicapped main^reamed / 
children. Due to methodological difficulties, this pilot rteaejpijtch fe^Qrt is 
not considered an adequate study of the effective use of the ADP-developed" ^ 
Supplementary Materials. Most important, however, is that much has been 
learned to guid§'^future research efforts in this area. Previously identified 

S^es^^are now briefly synthesized and discussed, and laajor situational 
variables, methodological isisues, and final design considerations to guide 
future research are offered. 

Jour situational variables are considered important and should be con- 
sidered in future research. These iricludet (1) resources available, their 
use, and quality; (2) family situation; (3) teacher differences; and (4) 
other curriculum employed. All these variables are con^dered prime contributors 
to Studying the benefits of supplemental curriculum instruction in terms of 
pupil progress. In the future, sufficient data to access the relative effects . 
of these variables must be collected. 

At the methodological level, several recommendations for further research 
are made. First, the original sample size should be sufficiently large to 
allow for more meaningful statistical treatment of .the data. Next, target 
pupils must be identified by employing a variety of criteria which allow for 
a more accurate match on all relevant variables. -Adequate and consistent 
instrumentation is also a must. Finally, extremely close data collection 
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/ 

monitoring shoiad be conducted on 'a continuous basis to reduce tne problem 
of missing data. j 

The Issues brougixt out in this pilot research have been didcxissecl by 
others.^ Like Badian /(1976) and Badian ahd Server , (1975) , these/ authors have 
disct^^sed the inadequacies of many techniques aimed to identify the ^oung 
child with learning disabilities and support the use of multiple measures, . 
Along with Wynn and Associates (1975) in a recent review of the research 
regarding mains treaming, the following common problems have been identified: o 
(1) small, unrepresentative sample size, (2) ^jor uncontrolled variables, 
(3) ' inadequate instrumentation, (4) lack of cross-program comparison^ (5) lack 
of longitudinal studies, C6) lack of generalizabili^y^'of results to preschool 
education as a whole. "A mixed strategy is proposed \o eliminate many of these 
problems. , 

In addition to multiple or mixed identif jt,pation and data collection, 
the most appropriate sugg-^stion for further preschool research applicable to 
the ADP-developed Supplementary Materials is that proposed by Moores (1974) 
who makes use of Chronbach's Characteristic by Treatment ^Interaction Model. 
It is felt that research consisting only of comparisons between two groups 
has subsequently limited value, and therefore, the study of different treatments 
for different pupils*^ is advocated. In the case of the ADP-developed Supple- 
mentary Materials, there were childj^n who were helped; there may also be a 

certain type of teacher for whom the Supplementary Materials are of particular ' 

( 

benefit* It is also suggested that the major focus of future studies be the 



'A 

identification of the characteristics of those teachers' and pupils \rtio realize 
the greatest benefit from the Supplementary Materials ^nd the conditions which 
promote the greatest benefit. 

■ n ■ 
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CHAPTER IV 
DISSEMINATION , 

0 

Dissemination Activities of the Ahllity Development Program have included 
presentations at major conferences, workshops and training sessions for large 
groups of people not directly involved in the program, mail-out distribution 



of pamphlets and abstracts of various products, as well as responses to requests 
•for information. 

The following tnree objectives in the origiijal proposal for this project 
related to diss^ination.' These were: ' 

1. To prepare informational materials on the products under development 
for the purposes of obtaining field test sites and ^disseminating 
information about the project. 

2. To conduct dissemination activities related to (a) sites already 
using Bilingual Kindergarten' . Program who are potential users of the^*^*^ 
Supplementary Materials and other sites and/or individuals working 
with young children, sites- which are. potential users of instruments 

^ and teacher training materials* 

3,. To compare the effectiveness of dissemination ef forts ^s measured -by 
rate of response to conference presentations, conference displays, 
arid mail-outs. 

In the original proposal, dissemination of information was not projected 
until the last half of the second year. Because of the numerous requests for 
information, however, it was necessary to begin .these activities during the* 
last part of the first year of the project. This made attainment of Objective 
Three Impractical. It was not possible to distinguish accurately between 
responses to presentations vs. displays vs. mail-outs as addiuiciial requests 
continued to trickle in or overlap. 

Objectives One and Two were accomplished to a greater extent than pro- ' 
jected. The dissemination activities are described in the following sections. 
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PRESENTATIONS 

Through oral presentatipns at conferences and workshops approximately 
600 pc^ople received information. The following presentations were made as 
a part of project activities. 



"i;arly Iderltification of Handicapped Children" Day Care Workers. Austin/ Texa$> 
- MarcK"l^i^7. 

' "Attitudes and Stereotypes Related to Parents" Teachers of Preschool Handicapped 
Children. Austin^ Texas > March^ 1977. 

"Early Identification > Screening anxi Referral of Handicapped Preschoolers" and 
"Attitudes knd Stereotypes Related to Parents" Child Care Personnel 
Inser^ice> Texas Department of Public Welfare. Austin^ Texas » February, 
1977. 

"Training CDA Candidates in Early Identification and Screening of Preschool 

Children" Community College Instructors, Richardson, Texas, January, 1977. 

"Counseling with Parents of Handicapped Children" Texas Association on Mental 
Deficiency. San Antonio, Texas, August, 1976.* 

"Interface: The Setting,' the Professional, the Parent — Early Childhood Con- 
ference" San Antonio, Texas, May, 1976. 

"Identification of the Young Bilingual Child who is Handicapped" International 
Bilingual/Bicultural Conference. San Antonio, Texas, May, 1976. 

"Identification and Supplementary Instruction" American Educational Research 
Association Annual Meeting. San Francisco, California, April, 1976. 

"Early Identification of Handicaps by Parents" Education Service Center. 
Austin i Texas, February, 1976. 

■ - % . ' 

"The Ability Development Program for Five-Year-Old's" Follow 'Tirough Conference. 
Austin, Texas, January, 1976: 

"Identifying and Teaching the Young Ch^cano who is also Handicapped" Head 
Start Conference. Houston, Texas, September, 1975. , 

"Multicultural Approaches to the Education of Ydung Chidlren" International 
Annual Convention of the Council for Exceptional Children. Los Angeles, 
California, April, 1975. 

< "Special Needs of the Young Handicapped Mexican American" Annual Conference: 
Council for Exceptional Children. Chicago, Illinois., April, 1976. 
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^'Information on New Instructional Materials" Early Childhood Classes* Univer 
^sity of Texas 9 Austin > Texas > Aprils 1976. 

**Teachers Working with Special Children" Early Childhood Special Educat.ion 
Class. University of Texas, Austin^ Texas, November > 1975. 

"Parent and Child" Child^Inc- , PAC. Austin,\T,exas, September, 1975. 

"Bilingual Program and Supplementary Materials^ Riverside Parents Night* 
Austin, Texas, Febmary, 1976. ^ 

I ' ^ ^ 

"Supplementary Materials for the Teacher^" Principals Meeting, Edgewood 
School District. San Antonio, TexasA^ August, 1976. 

"Special Needs of Mexican American Fai^ilies"^ Texas Mental Health/Mental 
Retardation* San Antonio, Texas February, 1976., 



\ 
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INFOKMATIONAL MATERIALS 

Copies of Che pamphlets » abstracts ^ and booklets which were distributed 

I 

or mailed during the project period are included in Appendix 

Pamphlets describing the total program were mailed or distributed to more 
"^than 700 persons. 

Inser ts > single column descriptives, were Included with mail-outs distributed 
by SEDL. This included more than 1>700 total program inserts and 1«000 copies 
of specific product Inserts (These Inserts were not reprinted after the initial 
supply was exhausted). 

Typed Abstracts providing more detailed informatit)n on specific products were 
mailed to approximately 600 individuals. In contrast to the pamphlets and 
inserts which were used for general idistribution^ the typed abstracts were , 
mailed in response ^to specific requepts for Information from the fields Tfius^ 
in one sense > these requests were a measure of the number of individuals .re- 
sponding to presentations or other written information. 



Booklets related to aspects of the project were printed in limited quantities 
and distributed at various conferences. These Included: 



thout Emptying Your Pocketbook - Mini Copyl* 
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"How to Fill Your Toy Shelves wl 

"Early Identification of Handicsjpping Conditions" 

"Observational Screening" 

"Speech and Language Problems" 

Instructional Manuals > During the Pilot and Field Test stage^^ copies oi' various 
manuals were disseminated at no chargk to the user. This included: 200 copies 
of Working with Parents of Handicapped CMldren > 350 copies of Observation&l 
Chec^lsts for Refer.V l^ 600 copies of How to Fill Your Toy Shelves without 
Emptying Your Pocketbook > and 30 copies of the Supplementary Materials. 

Other dissemination related to specific products developed under this project 
"has beerit conducted by the publishers, the Council for Exceptional Children and 
CTB/McGrkw-Hlll. In addition to BEH-u'sOE credit within product manuals ^ publi- 
city items distributed by CTB/McGraw-Hill also included acknowledgement of 
funding by USOE. (See Appendix B for copies). 

In addition to formal pi:esentatiorls> workshops > arid distribution of written 

materials, many persons have become aware of this project through visits to* 

SEDL. Graduate classes from the Departments of Special Education and Early 

I 

Childhood, Curriculum and Instruction at the University of Texas have regularly 

lio 
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come to SEDL for program presentations* Other project presentations have been 
made for persons from other countries (Australia ^ England^ Newfoundland » France 
Canada > and China) who have visited SEDL during the last two years* 

In sxnmna^y^ information regarding the project and the products developed 
has already reached several thousand Individuals* Dissemination will continue 

beyond^ the end of the project as the commercial publishers (CTB/McGraw-Hlll , 

* 

National Educators Publishing t!ompany^ and Council for ^Exceptional Children) 



provide information to potential users *% In all cases, recognition of the 

d* / 



funding so rce as well as recognition of SEDL as the produc^*r is Included* 



Thus, project efforts will continue to benefit an Increasing number of teac 
parents, and children. 



/ 
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o. CHAPTERV 
SUMMARY STATEMENT 



This report has provided the reader with a comprehensive review of 
the accomplishments of the Ability Development Project for Five-^Year-Olds . 
(BEH Project No. .44CH50237, Grant No.,. G0075Q0592) • This project was con- 
ducted from June 1, 1975 to May 31, 1977 and aimed tq develop supplementary 
instructional materials for use with handicapped Mexican American pupils 
mafhstreamed into kindergarten programs using the Bilingual Kindergarten 
Program as- curriculum base. 



The first chapter contained general project background and overview 
] ^ ' 

Information. Chapter II included a comprehensive description of the 

development process as well as the, final prdducts themselves. A discussion 
of some pilot research carried out during the second year of the project 

was the focus of Chapter III, while Chapter IV presented the breadth of v 

*■ * 
product dissemination which has already occurred. A brief description of 

> ^ 

; each ptoject-developed product, Including both accomplished and projected 
dissemination, and recommendations for future research conclude this 
report. 

The Spanish/English Language Performance Screening (S/ELPS) 

This instrument, originally designed under a previous grant, was com- 

. pleted during the presently reported project. Basically the S/ELPS is an 
oral language te'st designed to assist the classroom teacher in objectively 
determining eaqh child's stronger or dominant language for initial instruc- 
tion. It was developed as a method of comparing Spanish versus English oral 

.^♦recep-tive and expressive language performance in children. whose home ^.anguage 



. nay be Spanish* It does not make comparisons between children* Administra- 
tlbn is in two parts, Spanish and then English, and five language categories 
are available for child placement: Spanish (I), Predominantly Spanish (if), 

-Bilingual (III), Predominantly English (IV), and English (V). After for- 
mative data collection and analysis revealed high reliability and validity 
for iise with preschool and kindergarten Mexican American pupils in Texas, 
the S/HLPS was put out for bid by .commercial pUbliJHers. CTB/McGraw-Hill 
won the contract and published the S/ELPS in spring, 1976^ The published 
administration kit includes a manual, wanipulatives, pictures, and Spanish 
and English record forms* CTB/McGraw-Hill also sponsored further research^^ 

c 

which extended reliability and validity findings to Mexican American, Cuban, 
and Puerto Rican pupi:j.s, kindergarten through third grade. The S/ELPS became 
available for purchase in September, 1976. Through March, 197/ over 7,000 
S/ELPS kits have been purchased, McGraw-Hill projects that over 20,000 
copies will be sold during the following year as availability infortaation 
is disseminated. 

The Observational Checklists for Refe rral (OCR) 



The purpose of the OCR is to provide a standardized format 'with which 
to identify the problems of young children. In addition to a General check- 
list, several other specific checklists are available to the user: Health, 
Vision, Hearing, Speech and Language, Mqtor, Learning, and Behavior. An 
accompanying mahyal provides instruction for completion of the checklists as 
well as specification of behaviors to be noted. The OCR was originally 
conceptualized based on the experience of the Project Director in working 
with university-level elementary education students. Exploration of use of 
the OCR' was extended to preschool teachers during a previous project and 

.T24 . . •/ ' 



further extended to kindergarten teachers and day care parents during the 
current project. The OCR has been found useful for a variety of situations. 
Responses from both teachers and parents have J)een, favorable. However, 
additional work is needed before it can become available jEor general use. 

Instructional Manuals 

These four project products include Working with^ Parents of Handicapped 
Children / Trabajando con los Padres de Ninos Con Impedimentos , How To Fill 
Your Toy Shelves Without Emptying Your Pocketbook > and Como Llenar Sus 
Estantes con Juguetes sin Gastar Mucho Dinero , They provide practical, use- 
ful' information for both teachers and parents as their. titles imply. Early 
in the project, it was. felt that these manuals had an extended potential 
.for usefulnes^s; thiis', with the permission of USOE, they were released to the 
Council for Exceptional Children for publication., Published without copy- 
right or royalty to USOE, they are both available at a reduced price and 
legally reproducible by the general public. As of Marcht 1976, a total of 
1,949 copies had been sold. 

Supplementary Materials 

The primary purpose of this project was to design and develop Supple- 
mentary Materials which would enable the classroom teacher with no special 
edycation training to work with the mild to moderately handicapped child 
mains treamed within the bilingual kindergarten class. As developed these ' 
materials were designed to be complementary to the Bilingual Kindergarten 
Program (BKP), and include (1) Instructional Guide, (2) Entry Level Check- 
list, (3) a set of 5 X 8 Observation, Information, and Action Cards, (4) 
Home Activities, and (5) Supplementary Media Materials. Brief descriptions 



of each follow. 

1. Instructional Guide - Use of the supplementary card file, as well 
as backgrpund information on the development of . the Supplementary 
Haterlals is described. Also included are sections on methods of 

' ' teaching the different components of the Bilingual Kindergarten 

-Program; 

2. Entry Level Checklists - Provide- an organized method of .observation 
of the. child's ability to fiinction in the preschool setting, as welly 

. as references to specific information on handling problems and <ilass 

, room management. See Appendix for the Entry Level Checklists, 

3. Observation Cards Designed to be used with Visual, Auditory, Mot^r,. 
;v and Ideas and Concepts lessons ofr the Bilingual Kindergarten Program , 

each Observation Card identifies specific behaviors to observe in/ 

each lesson, and some Immediate remedial actions to be taken as 

wiell as references to Information and Action Cards and prerequisytte 
lessons in the BKP. 

4. Information Cards - These cards provide information and suggestions 
on how to handle problems' that may arise during the year. They are 

, divided into two main sections: Daily Routines and Classroom/Pro-- 
blems. 

5. Action Cards - The Action Cards include a variety of ideas, /techniques, 
't suggestions and activities for teaching specific skills or casks. 

Action Cards suggest: 

• alternate ways of teaching the same skilly. 
^ . ways to simplify the task by eliminating stimuli or limiting 

the material. / 
. a variety of ways that the. child might practice the skill or 

task» 

, practical do's and don't's from other teachers. 

6. . Home Activities - A total of 36 activity sheets designed to be used 

by parents with their children as a supplement to classroom instruction 
in each of the following skill areas: visual, motor, auditory and 
ideas ^and concepts. 

7. - Media - Additional media depicting handicapped children and adults, 
/ , which- can be substituted, for existing media in the Bilingual 

/' Kindergarten Curriculum is included. 

/ * 

Formative data suggest that the materials are especially valuable to beginning 
teachers, assistant teachers, and teachers with no special education training 
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are Reaching In a mainstream setting. 



Recommendations for Future Research 



The pilot data collected during the second year of the project was 



quite valuab 



and quality^ 
^plqyeL was 
as obtaining 
strategy for 

/ 



0.^ in that It highlighted the complexity of such research. The 
control; of such major confounding variables as resources available, their use 



family situation^ teacher differences^ and other curricultm 
found crucial. Also underscored were, such methodological issues 
a sufficient aample si^se^ designing a comprehensive identification 
"target pupils and their control match ^ Selection of adequate 



instrumentation^ and the importance of close data monitoring. At final 



analysis^ the Supplementary Materials are now ready for research and dissemination 
purposes. Keeping in mind the. control and other methodological issues men- 
tioned abovp, it is here suggested that the focus of such -research be on the 
identa.ficatj.on of characteristics of those teachers and pupils who realize 
the greatest^ benefit from the supplementaries and the conditions which promote < 
greatest benefit. 
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APPENDIX A 



EXTENDED STUDY OF THE S/ELPS: TEST SITES AND EXAMINERS, 
TESTING PROCEDURE AND RESULTS & 



r 

TAKEN FROM The Spanish/English Language Performance Screening (S/ELPS);' 
Extension of Reliability and Validity Studies with Cuban^ Puerto Rican and 
Mexican American Children Prescnool through' Third Grade ; Evans, Butler, 
Schmidt, Zuniga; July^ 1977; pp. 15-31. 

/ 
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,2. - Test Sites and Examiners / ' * . 

■■ • / 

Sites were selected fco includ^- students of Cuban, Puerto Rican, and Mexican' 
. \ American origin. Mexican American students were tested at 3 test sites ([Califomia. 
Wizona, -Texas), Puerto Rican children were tested in Pennsylvania and Cuban Stu- 
aents In Florida. Test, sites were chosen on the basis of their partxcipation in 
a\biiingual program and location within a predominantly Spanish-speaking neigh- . 
borhood. At each site, the students were randomly selected from lists of students 
witli\ Spanish surnames. All examiners were trained and supervised by a staff per- ' 
son from the Southwest Educational Development Laboratory. The examiners received 
. four hours of training before actual testing began. The training consisted of 
two hours of familiarization with the test materials and procedures, followed by 
two hburs of practice administration under the direct supervision of the staff 
i»ember. All examiners were bilingual residents of the local community and familiar 
' With the local dialect. In two sites, the examiners were familiar with ' the children 
being tested (San Antonio and Mami). In the other sites, the examiners had not .. 
met the children prior to» testing. 

tfexican Americans in Texas . One hundred and ninety-eight Mexican Ame.rican ^ ' 
. children in kindergarten through third grade were tested in San Antonio, Texas. 
Since the criterion related validity of the S/ELPS for use with kindergarten 
children had been established in previous studies, five-year-olds were not included 
■in this part of the study. The reasure of criterion-referenced validity was obtained 
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TABLE 2 
" SUBJECT/EXAMINER SUMMARY 



c 



Origin 



Mexican 
American 



Cuban 



Puerto 
Rican 



Site 



Number of 



Grade 



Test 



Date of / 



•School District A 
School District B 
(concurrent validity) 
San Antonio, Texas 


145 

_<53 

198 


1-3 


1 

Classroom 
teachers , 
assistants, 
and SEDL staff 


uunaxcxons 

Child's classroom 
and hallway 


xesting 
Sept* 76 


^ Yuma, Arizona ' 

p 


93 ^ 


K-3 


Assistant . 
teachers un- 
known to 
children 


School cafeteria 
and vacant 
classrooms 


Oct. 76 


San Diego, California 


166 


K-3 


Studeuts of 
the U". S. 
International 
University 


Child's classroom 
and vacant 
vacant classrooms 


Dec. 76 


Miami, Florida 


84 


K-3 

0 


Resource 
teachers and 
parents with 
limited- 
familiarity 
With children 


Outside child's 
classroom and - 
school cafeteria 

1 


Oct. 76 


Bethlehem, Pennsylvania 


201 


K-3 


Teachers • 
unknown to 
children 


Resource moms 


Jan. 77 



only_f6r_^.ildren-ln first through third grades (N«145) usihg teacher ratings of 
language dondnance. In determining the concurrent validity of the S/ELPS, , ' 
children in kindergarten through third grade who had 'already been administered 
the Jaises Test of Language Dominance were tested with the S/ELPS <N=53). The 
testing in San Antonio was conducted by teachers, assistant teachers, or Lab 
staff in September, 1976. SEDL staff administered the S/ELPS to children partic- 
'ipating in the concurrent validity study. The tests were administered within the 
child*s classroom and/or in the hall outside the child's classroom. 

r ' " ' 

Mexican Am ericans Outside Texas . A total of 259 Mexican American children 
in kindergarten through third grade were tested in Yuma, Arizona and San Diego, 
California. In Yuma, testing was conducted by assistant teachers who were not 
previously acquainted with the children. The testing was conducted in the school, 
cafeteria and in a vacant classroom. An additional sample of children in fourth 
through seventh grade were also tested. However, the results of these tests were 
not included in the data analysis because the number of subjects in this group 
was too small for meaningful analysis. In San Diego, 166 children were tested. 
The testers at this site were students from the United States International 
University and were not previously acquainted with the children. The" testl^ng 
was conducted in the child's classroom or In an empty classroom. 



Cubans , Eighty-four children of Cuban origin in kindergarten through third 
grade were tested in Miami, Florida in October, 1976. The examiners were resource 
teachers and par^ts of students. The exaraineTs" were familiar with some of the 
students being tested. Testing was^conducted in an area outside the child's class- 
room or in the school cafeteria. 
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Puerto Rlcans. Two hundred and one children of Puerto Rican origin in 
Bethlehem, Pennsylvania were tested during Janu&ry, 1977. Although these students 
were In an open classroom setting and were not grouped .^strictly according to their 
grade level, they had been attending kindergarten through third ^grade. There- 
^fare, there was less distinction between grades for the PuerXo Rican children 'than 
for the other groups' tested. The tests were administered by unemployed teachers 
and testing was conducted in the school resource room.r 

i 

3. Testing Procedure ^ j 

Although the testing conditions and examiners varied slightly from site to " 
site>. the same testing procedure as described in the S/ELPS manual was followed 
at all sites. Each child was individually tested by a bilingual examiner. After 
greeting the child > the examiner proceeded directly into testing in Spanish. The 
initial test questions (iComo to llamas?; ^Lienes hermanos y hermanas?; iQue te 
gilsta hacer en casa?) are conversational in nature and usually encourage the 
child to converse freely- It was noted that most children readily adapted to 
the testing situation and responded freely to the test questions and items^. The 
examiner recorded a verbatim account of the student's responses, adding comments 
on the record form when necessary. In no case was the child cued or told to' 
speak in one lahguage or another. At the 'completion of testing, the student was 
thanked for his or her cooperation and returned to the classroom. 

Following the testing of all students, the teachers were asked to give their 
ratings of the student's language performance on the same five point scale used 
in the S/ELPS. • A \7ritten description of each of the categories on the scale was 
given to the teacher to follow in rating each child. The teacher had no 
knowledge of the child's performance or rating on the S/ELPS. Therefore^ the 
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teacher ratings were independent of the S/ELPS results • Only tbe.l^riiijgual 
teachers or assistant teachers who had known the ihild for at least one oouth 
rated the child's language performance. 

4> Results 

IWo measures of test validity and four measures of reliability were 
studied. Criterion-referenced validity was evaluated by comparing the S/ELPS 
scores with an external criterion of oral language doknaiice, teacher ratings. 
Concurrent validity was evaluated by comparing the S/ELPS scores with the scores 
from the James Test of Language Dominance. The four reliability measures were: 
91) test-retest, (2) iiiterrater, (3) interscorer, and (4V-intratater. 

Criterion -Related Validity . "The external criteria against which S/ELPS 
scores were compared was teacher judgment of each child's oral language per- 
formance based on their classroom experience with the child for a period of at 
least one month. Classification of each child's oral language abilities was 
made according to the same scale used in the b, 2LPS, as described in the 
preceeding sectipn. In analyzing the criteriori related validity data (i.e., 
teacher judgments versus S/ELPS scores), the data from the Puerto Rican students 
were analyzed separately-. This was done because the teacher judgments for 
Puerto Rican students were not collected in the same manner as in the other four 
test. sites. Discussion of this variation and the data obtained are included in 
the following section. 

Pearson's product moment correlations wec-e^'tftus coraput»?d comparing teacher 
ratings and S/BLPS scores across all test jites, excluding Peixnsylvania. This 
analysis resulted in an. overall validity' coefficient of .83. Table 3 presents 
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the correlations between the S/ELPS scores and teacher classifications by site, 
by grade level > and by Spanish language sub-group. The resulting validity 
coefficients range from a high of .92 for all kindergarten children to .51 for 
all third graders. Validity coefficients of the Spanish language sub-groups 
rang^ from .83 for Cuban Americans to .68 for Mexiqan Americans in California. 

Table '4 presents a matrix of- the number of children included in each 

* • ■ . ' < . ' <, 

category by teacher rating and' S/feLPS classification; therefore,' the table 
portrays the rate of agreement/disagreement between these two measures o€ oral 
language- dominance. There' are indications that the teac|)er ratings at the second 
and third grade levels were based on their judgments of the child's overall 
language performance, inqloding subject area performance (reading, writing, and 
math) as well as oral language skilll, ^Therefofefv the validity coefficients 
for children in second and, third grade may have, been different (possibly higher) 
had the teacher ratings been based, solely on the cliild's oral language ability. 

Criterion Validity for Puerto 'Rican' Subjec ts, The validity data on the 
children of Puerto Rican origin was analyzed separately due to the fact that the 
criteria of dral language dominance used in* Pennsylvania was not comparable to- . 
that used in other test sites. In Pennsylvania ^ the criterion classifications 
were base^ on the instructional grouping of the students rather than the teachers' 
ratings by S/gLPS classifications. Th^^ Pennsylvania groupings were as fallows: 

(1) Spanish dominant - a Spanish speaker wht)se English abilities are 
insufficient for the child to profit from English instruction ^ 

(2) Bilingual - a Spanish speaker with some orad.\English language 
skills- x^ho is able to read in Spanish at the first grade level 

(3) ESL-S - children whose oral English language skills and English 
reading, skills are sufficient for reading in English with support 
through the explanation of concepts in Spanish 

» 
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TABLE 3 
Study C; 

Crlterlon.Referenced Validity Data Summary 



Location 




Kinder gar ten 


Grade 1 


' Grade 2 


Grade 3 


Total 


rupxx ungin 


N 


Corr. 


N 


Corr . 


N 


Corr. 


N 


Corr. 


N 


Con 


Texas 


Jlexican Amer. 






47 


.88 


48 


.71 


50 


.41 


145 


.7: 


Arizona 


Mexican Amer, 


40 


.96 


18 


.59 


35 


82 






V J. 




California 


Mexican Amer, 


43 


.79 


40 


.77 


42 


.43 


41 


.56 


166 


.6( 


Xx, Ariz, Cal 


All Mex.Amer. 


83 


.93 


105 


.84 


125 


.81 


91 


.51 


404 


.82 


Florida 


.Cuban 


21 


^84 


18 


.90 


19 


.93 


26 


.66 


84 


.82 


Tx, Ariz, Cal, 
Fla 


All Mex Amer. 
and Cuban 


104 


.92 


123 


.84 


144 


.82 


117 


• 51 


488 


.82 


Pennsylvania 


'Puerto Ricun 


30 


.50 


65 


.69 


52 


.70 


54 


.45 


201 


'.64 



iNote: All correlations are between teacher ratings and S/ELPS scores of pupil language dominance; 
Puerto Rican data is kept separate because different teacher rating criteria were employed. 
Pearson's product moment correlations are reported. 



TABLE. 4 



•J RATE OF AGREEMHIT BETWEEN , 
TEACHER RATINGS AND TEST SCORES 

TEACHER RATING 



Spanish 



Predominantly 



Predominantly 



59 


..i6 


9 

5 


0 


0 












— \ 

15 


50 


3,6 


3 


1 


8 


23 


146 


31 


6 
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10 


10 


11 


0 
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(4) ESL-E - children whose language skills-are sufficient for reading 
In English without Spanish support ■ 

(5) English - children who can function in a regular English program 
for academic learning 

Validity data for the Puerto Rican group are also separated because 

•> 

differences in the Instructional setting may have affected the criterion of • 
oral language dominance (teacher ratings based on instructing the child both 
in Spanish and in English). The other groups (Mexican American and Cuban, 
Atnerican students) were in self-contained classrooms, primarily ynder the ^ 
direction of a single bilingual person. The Puerto Jlican students were in open 
classrooms using a team- teaching approach with both Spanish and English speaking 
teachers. These students were under the direction of ^orejthan--one-per50n7' ^' 
depending upon the subject area and instructional language. For the purposes of 
research in establishing test validity, this presented two problems. First, 
teacher ratings were based on their knowledge of the child's language in relation 
to the subject area and the lariguage in which that subject was taught. Second, " 
the children had been grouped for instructional purposes using the same classi- 
fication titles but different criteria, as discussed, above. The extent to which, 
these prior groupings and subject area instruction influenced teacher ratings is 
unknown • 

For the Puerto Rican group, instructional groupings were compared with 
S/ELPS s.cores using a Pearson's product moment correlation coefficient. For 
the total group of 201 Puerto Rican students a validity coefficient of .63 
was obtained. In addition, a validity coefficient ws£s obtained for instruc- 
tional groupings and S/ELPS scores for the students at each grade level, 
kindergarten through third grade. While these data are also presented in Table 3, 
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it should be noted that the coefficients obtained are somewhat lower than those 
from the other test sites^ 

Significant differences^ between criterion related validity coefficients . 
Subsequent analysis was performed to test the significance of the differences 
between the criterion- related validity coefficients obtained for (1) the three 
Spanish language sub-groups, (2) the four grade levels, and (3) the five sites * 
involved in the study. As expected, the validity coefficients obtained for 

\ 

the Puerto Rican students were signif icantly_cii£ferfent from those obtained for 
bo,th the Mexican American and Cuban sub-groups (smallest difference =» .ISS; 
p .05) while there was no significant difference found when the correlations for 
, thQ Mexican Americans and Cubans were compared with each other. This is undoubtedly 
iiue to the difference in the rating systems employed as discussed previously. 
Given the data that was obtained, it can be stated that the S/ELPS has a high 
level of criterion- related validity for use with Mexican American and Cuban pupils. 
Because of differences in classroom organization and data collectio^i methodology^ 
only a moderate level of validity for use with Puerto Rican students has been 
confirmed. When considering the differences in correlation coefficients by grade 
levels kindergarten pupils were found to be significantly different from all other 

grades (smallest difference =. .078; p<:.05), while first and second grade 
pupils were additionally found to be significantly different from kindergarten 
(smallest difference = .078; p<C*05) and third grade (smallest difference = 
.305; p <^.05), but not to each other. This would indicate that the S/ELPS is a 
more valid measure of oral language performance when used with younger children 
(e.g. kindergarten through second grade). When the difference between the 
validity coefficients obtained at each site were tested, it was indicated that 
Arizona and Florida were similar to each other and significantly different from 
the others (smallest difference = .1; p <r.05), and Texas was significantly 
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different from Pennsylvania and California (smallest difference « .057; p ^ .05), 
while California and Pennsylvania were not significantly different from each other. 
Thus it is apparent that some factors related to^he test sites affected the 
validity coefficients, obtained. Figure 1 illustrates these findings. 

Concurrent Validity * Concurrent validity was evaluated by comparing 
perfc/rmance on the S/ELPS with performance on another measure of language 
dominance. A sample of 53 Mexican American chil4ren from grades K through three 
were administered the S/ELPS. These students had been previously tested with 
The James Test of Language Dominance two months earlier* Approximately equal 
numbers of students from each gr^tde level participated. Pearson* s product moment 
correlations were computed to determine the degree of agreement between S/ELPS 
and James scores* This analysis yielded a validity coefficient across all grade 
levels of .86. Thise results indicate a high degree pf concurrent validity when' 
comparing the results of the S/ELPS to that of the James. Table 5 contains a 
summary of this data. 

R eliability Studies . The reliability of the S/ELPS was evaluated by retesting 
a sub-sample of 326 of the 689 subjects who were administered the S/ELPS. The 
retested subjects were drawn from each, grade from each test site. In evaluating 
the reliability of the S/ELPS > measures of test-retest, inter-rater, inter-scorer, 
and intra-rater reliability were collected. ' > 

Test-Retest Reliability . Test-retest reliability of the S/ELPS was determined 
by readministering the S/ELPS to a sub-sample of students at each grade level at 
each test site (Total N = 326). Students were retested from one to three days 
following the first test administration. Although students were retested under 
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Study C: Significant Difference3 Between 
Criterion-Related Validity Coefficients 





Variable 


1 Correlation Differences 






Language Subgroup: 


Mexican American « Cuban < Puerto Rican 








.(r".82) ^ (r=.83) (r=.64) 
Kindergartener Grade 1 ■ Grade 2. < Grade 3 






Grade Level: 








/ (r=.92) (r-.81) (r-.82) (r-.51) 






Test Site: 


Arizona « Florida <r San Antonio «r California 
; (r».87) (r«.83) (r«.73) (r°.68) 


» Pennsylvania 
(r=.64) 
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Table 5 * 



Study C: Concurrent Validity, Test-Ret est Reliability 
Interrater Reliability and I^trarater Rrf.iability Data Summary 



Test 



N 



Origin 



Grade 
L evel 



Pearsor 
Correlatd 



Concurrent Validity* 
Test-Retest Reliability 

Interrater Reliability 

Int^rscorer Reliability 

Intrarater Reliability 



53 
326 

153 

90 

173 



Me:tican American 

Mexican American 
Tuerto Rican, Cuban 

Mexican American 
Puerto Rican, Cuban 

Mexican A:::erican 
Puerto Rican, Ciiban 

Mexican American 
Puerto Rican, Cuban 



K-3rd 
K-3rd 

K-3rd 

K-3rd 

K-3rd 



.86 

• 84 

.87 
.97. 

• 81 



^comparison of S/ELPS with James Test of Language Dominance 
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conditions similar to thos^ in the first test administration, in approximately 
half of the cases, a* different examiner retested the student. 



,A Pearson's product moment correlation was performed comparing the scores 
of - the first test administration to 'those obtained on the second administration. 
The results of this analysis yielded a reliability coefficient of .84. Summa- 
rization of this data is found in Table 5. ■ ' 

Intetrater and Int er scorer Reliability . In order to determine the consis- ' 
tency of the S/ELPS scores between different examiners, two methods were employed; 
First, two examiners tested the same child on two separate occasions (N » 153). 
Additionally, the test protocols of a sample of 5 subjects at each grade level 
from each test site were rescored by a different examiner (Total N = 90). 

One hundred and fifty-three subjects were rested by a different examiner 
than had administered the S/ELPS on the first occasion. A Pearson's product 
moment correlation was used to measure the degree of agreement between the two 
test scores for each student. This analysis yielded a reliability coefficient 
of .87. -In determining the degree. of iuttr-scorer consistency of the S/ELPS, 
90 of the test protocols were rescored after all tests had been administered. 
IfemSers of the SEDL staff rescored the S/ELPS by reviewing the total protocols. 
A Pearson's product moment correlation was used to determine the degree of agree- 
ment" between the test scores and the scores obtained on the rescoring. This 
analysis yielded a reliability coefficient of .97. Thus, two measu-res of inter- 
rater reliability were evaluated, one related to scorer differences influenced by. 
the administration and scoring of tha S/ELPS by two different examiners, and the 
second related to the score differences influenced only by the rescoring of the 



protocol. Summary of the correlational data obtained in this part of the study is 

found in Table 5* Table 6 is a matrix which depicts this rate of agreement for 
test-retest rel^iability with different examiners* 

In t r ar a t er Rel iab il i ty > A sub-sanple of 173 subjects were retested on two 
occasions byj the same examiner." Subjects from each grade level at each test • 
site were retested in this condition. As in the condition where subjects were 
retested by different examiners, subjects in this condition were retested one to 
two days following the first administration of the S/ELPS. A Pearson's product 
robment correlation was employe id to determine the degree of agreement between the 
two S/ELPS scores for each individual. This analysis yielded a reliability 
coefficient of .81. Table 5 includes a summary of these findings, while the 
rate of agreement matrix of scores from the first administration compared to those 
of the second administration is pof^trayed in Table 7. The difference between 
the correlation coefficients for retest'data for same examiner (r = .81) versus 

that retest data for different examiner = .87) was analyzed to determine if 

\ 

the difference betweien coefficients was significant. The result^ of this test 

1 I 

indicated thajt the difference between the correlation coefficient's was not 

1 

significant (p = .07). 
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Study CJ / 

RATE^OF AGREEMENT FOR TEST-RETEST VIT^ DtFFERENT EXAMINERS 
BASED ON A SUB-SAMPLE OF 153 $UBJECTS 

7'-^ FIRST 
/' ADMINISTRATION- 

Predominantly Predominantly. 
Spaijtish ^ Spanish Bilingual 



24 



12 



57 



English 



■ , . • t Study C:''. 

RATE OF A(aiEEMENT FOR TEST-RETEST WITH.'SAME EXAMINERS 
BASED ON A SUB-SAMrLE OF 173 SUBJECTS 
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Bredominantly 
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Bilingual 


Predoiiinantly 
English 
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0 




4 


20 


^ 

8 


2 


1 


2 


7 


"68 


6 


2 


0 


1 


3 


5 


2 


0 


0 


1 


1 


12 



APPENDIX B 
PUBLICITY INFORMATION 



CTB/McGraw-Hill 
and 

Council for Exceptional Children 



e 



100 



137 




SPANISH/ENGLISH LANGUAGE PERFORMANCE SCREENING 
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a measure 9f languivje dominance 



Available September 1976 



WHAT S/ELPS IS DESIGNED TO DO ' 

* 

The Spanish/English Language Performance Screening (S/ELPS) provides an objective measure of a.child's 
stronger or dominant language for initial learning in a bilingual program in Grades K-2 and in day-care 
centers. S/ELPS was developed at the Southwest Educational Development Laboratory (SEDL) under a 
grant from the U.S. Office of Education. 

BENEFITS PROVIDED BY S/ELPS 



• identification of a child's dominant language and degree of bilingualism 

• identification of a child's better language for additional testing * 

• descriptive case studies and recommendations for instruction 

• organization of all assessment materials into a convenient classroom kit ^ 

• a simple, quick administration and scoring process 

• use of realistic objects for presentation of test items 
^ less expensive kit than others on the market 

COMPONENTS OF S/ELPS 

S/ELPS is packaged in a convenient, organized cidssroom kit that contains the following components. 

Manual - contains all directions for admmistrdtion and use, interpretive information, and technical data 
in a sturdy, long-lasting, spiral-bound format 

Stimulus Pictures - four different, realistic representations in full color, laminated for long wear 

Manipulatives - two boxes of toy materials used^ for administration, as follows: 

Box I Cup, plate, spoon, comb, mirror, watch 

Box II Baby, bottle with nipple, bed, chair, table, scissors 

Record Forms sufficient report forms for forty students (if duplicates are not required for student 
records, there are enough forms for eighty student) 

Carbon Paper - folder contains five sheets of carbon paper for use with record forms 
ADMINISTRATION OF S/ELPS 

Any bilingual adult can administer S>'ELPS. The test consists of two parts, the Spanish section, admin 
istered first, and the English section, administered second. The two sections contain equivalent but not 
identical items. S/ELPS is individually administered in a single session and is scored at the same time that 
the answers are recjDrded. The entire battery takes ten to fifteen minutes to administer and score. The 
assessment activities have been designed to be interesting and simple for the young child, so that per 
formance depends only on ability to understand and use the language being tested. 



S/'"LPS offers preschool and primary grade teachers the following: 
• a test designed specifically for the classroom teacher 



O ^'VlcG RAW. HILL • DEL MONTE RESEARCH PARK • MONTEREY, CA 93940 • (408)6498400 
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S/ELPS RESULTS \ 

S/ELPS compares a child's performance in one language with performance in the other language. It does 
not compare children with each other or with a norm group. The results are used to assign Children a 
language category "that describes their behavior in both languages. The language categories used m scoring 
S/ELPS are: 1 

Category 1 - Bominantly Spanish; almost no English 

Category 2 - Spanish dominant; knows some English 

Category 3 - Bilingual (equal use of both languages) 

• Category 4 - English dominant; knows some Spanish n 
Category 5 - Dominantly English; almost no Spanish I 
Category 0 - Insufficient performance to evaluate 

TECHNICAL DATA 

e 

The S/ELPS Manual includes=>a summary of the technical data gathered on this instrument; a full report is 
available from the Educational Resources information Center (ERIC). The technical data indicate that 
S/ELPS is a valid and reliable instrument for use in bilingual education programs. 



PRICING INFORMATION 

Classroom Kit - Contains a Manual, two boxes of six manipulatives each, one set of four full-color picture 
cards, and forty report forms each in duplicate, w:' ^ ^arbon paper $40.00 each 



ORDERING INFORMATION 

S/ELPS can be ordered from the Order Services Department, CTB/McGraw-Hill, Del Monte Research Park, 
Monterey, California 93940. Additional information on S/ELPS can be obtained from your nearest 
CTB/McGraw-Hill Regional Office listed below: 

EASTERN 1221 Avenue of'the Americas, New York, NY 10020 (212) 997-4866-7 

SOUTHERN 100 Colony Square, Suite 1801 , ,xtlanta, GA 30361 (404) 892-2868 

MIDCONTINENT Manchester Road, Manchester, MO 6301 1 (314) 227-1600 
WESTERN 3200 Wilshire Blvd., South Tower, Los Angeles, CA 90010 (213) 487-1160 
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Spanish/English Lansucge Performance Screening^' 
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^The children enjoyed S/ELPS. Itwos like a ganIL 

I 
I 
I 



THE NEED FOR S/EIPS 
In the past, few teachers of 
bilingual programs Icnew 
exactly where to begin in- 
struction. They were not 
sure whether to teoch in 

- «^ 

English of ^nish, since each chfld*s language back- 
ground differed. A bilingual ct.Ild often spolce a 
lar>gucige with relative ease, yet had great difficulty 
looming in that language. Without knowirig each 
chikl*s dominant or stronger longuage, teachers run 
the risk of doirig irreporoble damage to children's 
educotionol prcjgress. Now, with S/ELPS, teachers have 
an easy w.ay of determining each child's dominont 
language for beginning instruction. 

1t Iplped ne find out why 
some of the children were 
having problems learning. 
They didn| understand a . 

, certain language." * 

S/ELPS.was dev€ loped at the Southwest Educational 
Development Laboratory (SEpL) under a grant from the 
U.S. Office of Education to investigate bilingual screen- 
ing methods arid to devise an effective instrument in 
this areo. S/ELPS was extensively field-tested and vali- 



dated by SEDL, and technical data showing S/ELPS to be I 
a reliable and valid instrument for use in bilingual * 



education programs is published in the Examiner's 
Handbook. 



I 



HOW S/ELPS WORKS ^ 
S/ELPS provides an objective'^ measure of a bilinguol I 
child's dominant language and the degree of bWfh 
guality in the socond language, without the requk^ ^ 
ment of an extended period of obsen^ation. Children I 
can then be easily grouped by S/ELPS classificqtiom 
for instruction. m 
Specifically designed for the classroom p 
teacher, S/ELPS is simple and quick to odminister and 
score. Screening procedures are informal, and the 
saeening takes obout fifteen n^inutes to administer 
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sun/sol 



ond score. The activities have be^en designed, to be 
interesting and easy for the young child, to ensure 
that performance depends only on the ability to under- 
stand and use the language being tested. 

"I really enjoyed the manual. 
I was not aware or ^did not 
' believe that many Mexican- 
American chiJdren did not . 
know what some objects were 
called in Spanish. I don't 
think this manudl/could 
be' improved mb\e. It is well 
planned and pi^epared to use." 



The manual (Examiner/s Handbook) 
explains the screening^ 
procedures, scoring process, 
use of S/ELPS for instruction, 
and the technical data 
behind the instnjment. The 
screening maybe 
administered byany bilingual 
person who is experienced 
in working with young 
children, 

QUOTES AIK FROM ACTUAL TEACHER COMMINIS ON S/aPS 
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: S/KKOmnSREALUNinTS 

: • idwiMteation of a chilcPs doroiiian) tanguogo and 

dtgm#of bHIngualism^ ' . 
> • IdtoiiMfcciMun of a chHcfs bcNw ianguagd for 
oddmonoitesNng 

• ctoicr4)tlv» COM studies and recommendations for 
inttnictibn . ^ 

• organization of oH assessment materials Into a 
convenient classroom kit , 

;r / • a simple, quick administration and scoring process 
use of realistic pbjectsWpresentation of test Items 
%; toss expensive kit ttian others on ttieinarket 

S/EIPS IS convenienhy^ckaged 

' S/EIPS is packaged in on organized classroom kit ttiat 
V. contains tt» folk>wing components: 

PCAMNER'S KANDBOOK-contoins all directions for"^ 
|, odnmstration and use, interpretive infonmotion, ana 
jj; le^italcai data iii a sturdy. long-la$tin5, spiral-lx)und 
•■ .tonvKif . 

STMMLUS PICTURES-four alfferent, realistic representa- 
tions in full color, laminated for long wear 
STIMULUS OOJECTS -f two boxes of toy materials used for 
adg»inisfrotion,asfcJlowsi~ ^ 
lox I Cup, ptate; spoon, comb, mirrcT, watcti 
. ' lox II Baby, bottle witti nipple, bod, ctiair, table, 
f- scissors / 

RECORD F0RM9- sufficient report forms for fcfty stu- 
dents (if duplicates ore not required for student re- 
. cords, ttiere ore enpugh fomis for eigtity students) 
CAinON PAPER - folder contains five stieets of carbon 
paper for use with recorcl forms 

Cniiilli-IILl 

HOW TO ORDER S/ELPS . . 

S/ELPScan be ordered from the Order Service 
Department, CTB/McGraw-ltill, Del Monte Research 
Park, Mortterey, Califomia 93940 (408) 649-8400. 
Additional information on S/ELPS may be obtained 
fronn your nearest Regional Office listed below: 
EASTERN 

1221 Aiwnue of the Americas. New York, NY 10020, (212) 997-4866-7 
SOUtHERN 

100 Colony Square, SuHe 1«01. Atlanta, Go 30361, (404»a92-2868 
MIDCONTINENT 

ManclMtter Road, Manctiester, MO 63011, (314) 227-1600 
. WESTERN 

3200 Wilihire Blvd., South Tower, Los Angeles, OA 90010, (213) 487-1160 
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APPENDIX 

SUPPLEMENTARY MATERIALS: ENTRY LEVEL CHECKLISTS 



ENTRY LEVEL CHECKLISTS 



Purpose 

During the first weeks of school, you will be spending much of your time 
planning, organizing, setting up centers, establishing routines, and becoming 
acquainted with the children. Informal observations will be taking place 
throughout this time period, and from them, you will form opinions and make 
decisions on scheduling, grouping children, teaching methods indicated, etc. 
f> 

The Entry Level Checklists include specific behaviors which are very 
basic to the child's overall level of functioning in the kindergarten. There 
are two checklists (one for days 1-5 and another for days 6-10) to be completed 
after each individual child has attended five and ten days. This allows time 
for the child to become familiar with school setting, routines, teachers and 
other children. Each checklist covers five categories of behavior (behavior 
which the majority of children should exhibit fairly consistently upon entering 
kindergarten). Included in each category is a desired entry level behavior 
with two or three behaviors which indicate the child's level of functioning 
as opposed to the level on which you would like the child to function. 

The Entry Level Checklists do riot only structure your observations, but 
also provide a simple method of recording what is observed. In addition, the 
checklists include all children on one form. They will supply you with four 
types of information: 

1. Identification of those children who are fairly self-sufficient 
and ready for group learning. 

2. Identification of those children who need some additional help 
to reach the kindergarten-^readlness level. 

I 

3. Identification of specific areas of difficulty for each child. 

4. Reference to an Information Card which provides suggestions for 
remediation. / 

From this Information, you will/ immediately pinpoint difficulties, be able to 
begin remediation, and will prevent major problems. Use this information to 
group children who are weak in /one behavior with those who are strong and are 
good models of the desired .behavior . 



Instructions for Completing Checklists 



1. Review the checklist^ "so that you will be aware of the behaviors to 
be observed. 



2. After a child has attended school five days, complete Entry Level 
Checklist J, placing a check mark beside the behavior which best 
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describes what the child does in each of the five categories indicated. 

Refer to the Information Card indicated in the box beside the behavior 
checked* 

After the child has attended ten days, repeat the above procedure to 
complete Entry Level Checklist II. 

Checklists I and II should be completed for all children who have 
attended kindergarten for the required number of days prior to the 
second month of, school. 
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ENTRY- LEVEL CHECKLIST I (DAYS, 1-5) 
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5. C00rER.'\TES IN THAC-iEPv-DIR^CTED GROLT ACTIVITIES 
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ENTRY LEVEL' CHECKLIST II (DAYS 6-16) 

/ 
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APPENDIX D 
SUPPLEMENTARY MATERIALS: HOME ACTIVITIES 
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HOME ACTIVITIES ' 

!. Iptroduction. • • * , 

rer^chers and other staff v^o work with parents will want to do every- 
thing Iposs ibie to meet the special noed3 of the child with a problem. If 
a chiia in your classroom has a disability that could keep jiim or her frpm 
doing his or her best, you will want to work closely with the parents. 
Working \together, you and the parents can try to keep whatever problem the 
child maM have from seriously affecting learning and development. 

The SuopI ementary HoTne Activities are designed to be used along with 
the Supplementary Classroom Activities of the Bilingual Kindergarten Pro- 
gram (BKP).\ The Supplementary Home Activities are divided into four skill 
areas. Visual, Motor, Auditory, and Ideas and Concepts, the major compo- 
nents of the \ Bili'ngual Ki ndergarlon Program , and are designed to supple- 
ment c I ass room\ instruction in these areas. For example, if b child has a 
visual problem,-\ and is having difficulty with the Visual Lessons of the 
Bilingual Kinderjjarten Curriculum , you would send hone Visual home activi- 
ties. 



1 1 . What Is Included 

The SupplementaA^ Home Activities include four Home Activities sheets 
for the first nine units of the.BKP. Tliese arc for the following skill 
areas: , 

•Auditory ^ Visual 
Mo1or Ideas and Concepts 

Each Homo Aclivity sheet includes three five activities and 
jnstructions for mdking a home learning item. The activities are simple 
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and materials are listed which can be found around the house* 

At the end of each activity sheet. is a feedback form^^which should be 
completed by the parents, cut off, and relurned to you. This gives the 

• par:ent a way of reporting back to you and gives you a means of noting 
problems which the child or parents may be having in doing the activities. 

ill. When To Use The Supplementary Home Activiti'^s 

Once a child has been i dent if led as having problems in a particular 
area of development (visual, motor, audi Tory, ideas and concepts). It Is 
Important to meet with the parents and let them know that their help Is 
important. Explain to the parents that there are activities which they 

* can do at home to help the child learn. 

IV, Instructions To Parents 

Tell the parents that you will be sending activities home about once 
every two weeks, and that these activities will be easy to do, should not 
take more than ten minutes, and will not require any expensive materials. 
The materials should be easy to obtain (things usually found around the 
house) or easy to make. 

Remind the parents that the activities should be enjoyable for parent 
and child, and that it is not necessary to complete all the activities. 
lh& parents can choose the activities they prefer. Or perhaps you could 
mark the ones which you feel would be most helpful for the child. 

Instruct the parents to help the child, as necessary. In doing the 
actlvfties. Explain that many of the activities will need to be repeated 
several times before the child will be able to complefe them without help. 
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How To Use 

A. Select the appropriate skill area - the component of the Bi I Ingual 
Kindergarten Curriculum in which the child is having difficulty. 
Auditory Visual 
Motor Ideas and Concepts 

B* Select the Supplementary Home Activities for that component. Be 
sure the Unit number matches 1he Unit of the BKP you are teaching 
or one you have completed. 
C. Read the activity sheet before giving It to the parent. 

1. Select the activities which would best suit the child's needs. 

2. Circle those activities which you want the parent to do with 
the ch i I d . 

3. Ask the parent to complete the activities and to fill in the 
feedback form at tie bottom of the activity sheet. (The form 
should be cut along the dotted line and returned to you.) 

4. Instruct the parent to be as thorough as possible when com- 
pleting the form and to note any problems so that together you 
can learn the best ways of working with their child. 



I Go 



© SEDL, 1977 



HOMu Acrivri ihs 



ATTEMDING TO SOUNDS - Listen 1o differenf kinds of music with your 
child. Talk with tho child about 1he music, whether it is fast-slow, 
about which he or she likes best and why. If you have a record .player, 
check out children's records ^frorn tho public library. Visit the 
library with your child and let him or hor choose a record to take 
home. Play a record fast/slow, or loud/soft. Nave the child imitate 
you as you clap to the speed or loudness of tho music. You can do the 
same activity with a toy drum. Point out sounds to the child as you go 
about your daily chores. -Call attention to everyday sounds. For exam- 
ple: the doorbell, the telephone ring, the sound of water dripping, 
the sounds of different appliances, or, an airplane. 

LOCATING SOUND - Increase your child's awareness of the direction or 
location of sound. Stand in one corner of the room. Tell your child 
to stand in the middle and to liste.) as you clap your hands or ring a 
bell. Ntove to another corner and repeat the sound. Tell him/her to 
point in the direction of the sound. Ask another child, or another 
adult, to play a game with you. Tell the chiL' -^-o stand in the middle 
(blindfold the child) as you and the other person take turns clapping. 
Tell the child to point in the direct'on where the sound was made. 
(You may have to demonstrate this at first.) 

IDENTIFYING SOUNDS - INSIDE - Make different types of sound such as 
those listpd. Name ^he sounds and help your child imitate you. 

c apping ^sneezi ng 

coughing "'singing • 

Using objects found around the house (i.e., spoons, pans, scissors, a 
mixer, an alarm ^^lock, a whistling tea kettle), have the child listen 
as you make different sounds. Later, play a game In which the child 
listens without looking as you make a sound and then shows you which 
object made Yhe sound. 

IDENTIFYING SOUNDS - OUTSIDE - Go for a walk and help the child listen 
for and identify tho sounds of birds singing, cars passing, horns^t low- 
ing, etc. 



MAKE AND DO - LISTENING TUBS 



Fill eight margarine tubs with plastic lids with four differ- 
ent materia Is* For example: two with flour, two, with but- 
tons, two with nails, two with pins. Have your child shake 
the tubs and match the ones that sound a I ike ♦ 
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EVALUATION - AUDITORY 
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liOMC ACTIVITICS 



I* RflYMING - To help your child understand rhyming, explain, "I'm going to 
say some words that sound alike." Say, "bee, dee, tee, tee, fee." 
Then 1ell your child to repeat each word after you. Say: ^ ^ 

bee, dec, tee, see, fee bat, hat, cat, sat, rat 
doo, moo, koo, loo, boo ^ no, so, lo, go, po 
If this activity seems easy for your child, you can expand it by saying 
each row of rhyming v/ords and asking the child to think of more words 
that sound a I ike. 

2.. ATTENTION AND MEMORY - To improve listeaing and mernory, choose a simple 
story your child likes and' help the child learn to tell the story. 
Read or tell the story several times during the week. Encourage your 
child 1o say the words with you. Stop during the story to ask, "V/hat 
happened next?"- and allow your child to answer. Gradually reduce the 
a^nount of ta I ki ng you dg, so that the child is telling the story anC 
you are filling in the missing parhs. 

3. MEMORY - Help your child learn the names of objects. Look through a 
catalogue or magazine with your child and tell him or her to listen as 
you name two objects you see in the picture (choose object? the child 
is already familiar with). Tell the child to find the two objects you 
named . 

A. LISTENING - Help your child learn to listen and to fol low instructions 
by playing a game with your child while working in the garage or out- 
side. Tell your child to listen as you hammer one time. Tell the 
child to hold up r\\e finger, because you hammered once. Then hammer 
•and have the child hold up two fingers. Repeat until yop feel 
:hild understands when to hold up one finger or two fingers. Then 
ten the child to lurn so that he/she cannot see you. Say, "Listen 
, carefully. When you hear me hammer one time, hold up one finger, \ihen 
you hear me hammer two times, hold up two fingers." 




MAKE AND DO - RHYMING GAME 



f Make a rhyming card game. Cut out and paste on 3" X 5" cards 
pictures of rhyming words such as the following: 

cat - hat key - tree ' 
bug - rug man - can ' 
Name each picture. Spread the cards on the table and tell 
the child, "I'm going to name one picture. I f/ant you to 
find a. picture of the word that sounds like the , one I name." 
You may have to help the child at first. For example, if the 
child does not answer when you say find the one that sounds 
like cat, say, "Does hat soun^J like cat?" Or give the child 
a choice between only two pictures. Again, you may need to 
say the words for the child at first. 
- 
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EVALUATION - AUDITORY 5 
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HOML ACTIVITIfS 



U.ll. / 



BODY COORDINATION - To improve largo rnuc.cle development and coordina- 
tion, help your chi Id: 
jump up and down 

jump over a lino or piece of tape on the ground 
jump over a rope held one inch, two inches, three inches from 
the ground 

NOTE: If your child has difficulty jumping, hold his or her hand and 
jump with the child. Help your child jump down from a low step or 
small stool. It often takes practice before a child is able to jump 
without hel p. 

PLAY BALL - Tel I your child to sit on the ground with his or her legs 
spread apart. You sit facing your child about 3 feet away. Roll the 
ball to each other. Change the game by rolling the ball as quickly as 
you can to each ol'her^ Alternate rolling the ball slowly three or four 
times and switching to fast. 

WALKING BOARD Find a long r irrow board (about four Inches wide and 
four or five feet long). Give your chi Id an umbrel la and tel I him or 
her to pre^end to be walking ^ tight rope. Hold your child's hand if 
necessary, but encourage him or her to walk alone. This is also very 
good for ba lance. 

If a board is not* available, tape masking tape to the ground, draw a 
line on the groond with chalk, or tie bricks to either end of a six 
fooi rope. 

POTATO WALK - Give your child a large cooking spoon with a potato on 
it, and tell the child to walk as far as he or she can without dropping 
the potato. Mark the place where the potato drops e^ch time, and 
encourago the child to gp farther each time. 
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MAKE AND DO - STEPPING STONE 



From cardboard, cut out 20 round or oval shaped pieces approx- 
imately 6" X 6" to use as "Stepping Stones." You or your 
child- can place them in various patterns (about 9" apart). 
Show the child how to tiptoe from one "stepping stone" to the 
next. 
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EVALUATION - MOTOR 2 
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SORTING OIU I CIS T liolp your chiici lo sort objocis, OrilfKir severol 
t'fojio of lf»ruc (liffotoni types, such ciS beons, mjc;ironi, boods, or but- 
tonfw FMjco oil the i l'em:> in a cc>l^nc|0 ctiocso or butter cont^jiner* 
Give your' child tfio onto i nor ond o divided IV dinner tray or o t"hreo- 
sect ionod poper plalc;» Toll your child to s>eloct objects from the con- 
tainer £]nd put oil the onos thoi are c»lil<e in fho name section of the 
1 ray . 



PORTING COLORS - Help your child 1o reitch and sort colors. Cu^ or 1ear 
several piecer* of colored paper (fojr dUfcrertt- colors) and put in a 
bowK Divide o sheet of whit-e 8 1/2" X II" paper into four sections* 
Tell your child 1o paste all of the I i l<e colored pieces in the same 
section of fhe paper » 

MORE MATCHING AND SORTING - Gather several small object's of differeni 
colors (i.e., butlons, beans, plastic forl<s/spoons, beads, colored 
cereal). Have your child sort these by placing all like objects in 
one bag, box or other container, R-?peat 'the game by having [he child 
place all objects of ihe same color together*. 

LOOKING FOR DETAIL - Help your child focus and attend 1o detail in 
pieties* Cut' out a circle or square from 1he center of a piece of 
pape*to mal<e a "v/indo,*" Put the paoer "window" on top of a picture^ 
Tall< about wha1 t-he child can see* Cut "windows" in several places on 
another sheet of paper. Place the differeni paper over the same pic- 
lure* Talk about what ihe child can see now that he/she didn't see 
before* 
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I-:AKE AyO DO - CRACKER SHAPES 

Gather crackers of different shapes: oyster or Ritz (circle), 
saltines or wheal thins (square), graham (rectangle). Town 
House (oval), and Triangle. With a pen or magi.c marker, trace 
one of each of the different shaped crackers on a white styro- 
foam tray (the kind in which meat is packaged). Tell your 
child to match the crackers to their outlines (child will 
place the round cracker on the circle, the triangular cracker 
on the triangle, etc.) 
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EVALUATION - VISUAL 3 . 
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V.\>'c)rt? now s^udyifly a unil on clo1hi(ig. V/o jro lojrninj the names of varV- 
ous clolhing arriclo" an*! the piirt of fhe b-^^J/ or. which they, are worn. We 
cjre alr>o kMrnrncj ab:)ul when and for wha^ p.-pooc, diffcrcn^ ar Holes of 
*clo1hing are worn. .For ox<jniple, coa It, are .-.■^rn in Hie winter, when it is 
cold.' Coals keep us warm. You can help yuur child name and describe 
clothing. ' * ^ 



Talk lo your child as the child is dressing. Ndmo each article, .lave 
'the child repeat. Talk about \ho color c:nJ's>i/o. Talk about where (on 
whal'par^ of Ihc body) encti arlicle of clothing is y/orn. Tor example, 
"Oh, I see you've got your brown socks. V.'e wear socks on our feet." 

Before |-elling the child tfte name or whore a piece t)f clothing^^is v/orn, 
ask the child to tell you. I ^he child doesri't answer or doesn't 
know, le^ the child chooso from two ans.;ers. For example, "Is this a 
shirt or pants?" If you must ansv/er for the child, hove the" child 
repeat the answcY . Also, describe the clothing. For example, "This 
shirt har> a bear on i t." or "These pants have a zipper." or "Look at 
the pretty green but1o> s on this dress," - * 



Find pictutes in magozifics of, people 
weal her. For example: 

V/arm w.eafher- a child or children in 
Cold weather- people in coats, sweato 
Rainy weather -people in raincoats, b 
Paste the pic^uros on construction paper 
your child and talk about what |-hc peop 
and why. For example: "Oh, that girl 
cold." or "ll's warm and those children 
can go swimnWng, 
coats." 



or "It's raining so 



ressed for different types of 

swim suits' or sun suits. 

?, hats, gloves, boots, etc. 

ois and carrying umbrellas. 

Look at the pictures with 
le in the pictures are v/earing 
has d sweater on because she is 

r.'-e wearing swim suits so they 

hey need I heir boots and rain- 



Pack a suitcase for a pretend trip. father various clothing items. 
Encourage your child to name and describa them as he or she puts them 
into the sui tease. 



4. Using the clothing items galhered for actiyi/ty number 3/ play a travel 

where it will be cold and v/et. 
your child choose 3 or 4 ftems 
boots, coat, sweater, etc.) 



game. Say, "I'm going lo the North Pole 
What will I need to take with me?" Hcve 
suitable' for cold v/eaiher (hai, glover 



V^ry the activity by 
stormy v/eather," etc. 



Agoing to Florida (w^rn^cl ima tc) ," "going out in 
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^ MAKE A^D DO 

Draw outlines, on severfil piece 

cles of clothing, For\example 

coat, a shoe, etc. A've your child a bottle of glue 
scraps (i.e., old buttons, glitter, pieces of'yarn, beads). 
Let the child decorate th^ pictures. 
\ 



CLOTHING PICTURES 



of paper, 
a c -ess 



of d i f ferent art i- 
a sh irt, pants, a 
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APPENDIX E 

SUPPLEMENTARY-MATERIALS : MEDIA-EXAMPLES 
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APPENDIX F 

FORMATIVE FEEDBACK FROM TEACHERS AND ASSISTANT TEACHERS 
USING THE SUPPLEMENT/iRIES - 
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FORMATIVE FEEDBACK FRO^r TEACHERS AND ASSISTANT TEACHERS USING THE SUPPLEMENTARIES 

> 

1. On the average, hov^ m^iny times during the week have you used the Supplementary 
Activities and with how many children. 

a. Observation Cards - '*Twice a day with twenty seven children." 

"Approximately 20 ti es. If I started the unit." • 
"All the time with al] the children." 
"Fifteen times." 
/ "Once a week" , 

"Four to five times with 6 to 8 children." 
' "Never." 

b. Information Cards - "Twice with 5 children." 

"Once with 3 children." 

"Three times with 6 to 8 children." 

c. Activity Cards - "As much as twenty times if I'm starting a 

new unit." 

"Three to five times." 
"Once a week." 
"Not too often." 

"Four to five, times with 6 to 8 children." 

'2. Should any parts (Initial Checklists, Obcjervation, Information, Activity 
Cards) be omitted? Wliich ones? 



'No 

"No. I feel experienced teachers need an activity 
box more on their level. Present activity box 
exhibit s what experienced teachers have applied 
throughout the year . " 

"The activity cards are .not very original." 

"Activity Cards need more study. Need better 
solutions for different problems." 
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3. What is your opinion of the general organization of the Supplementary 
• Activities: Please lisl. any suggestions for reorganization* 

"The Supplementary Activities are** good except 
for the Activity Cards • More originality or 
bettf.r solutions are needed," 

' * » 

"To me, it is very helpful. Sometimes I don't 
know where there is a problem, I look at the 
Observation Cards and I can tell where they 
need help," 

"Organization is easy to use," 

"Add information to Observation Cards," 

**Organiza\:ion is very good. It is the solution 
that is not very original," ^ 

"Good organization and simple to use. Good, 
follow ups, " 



4, What is your opinion of the format of each partJ Please describe any 
* suggestions for change or patticular^ sttiffngHis, 



Initial Checklists 



b. Observation Cards 



Information Cards 



d. Activity Cards 



"Good," 
"Very good," 
"Very Good," 

"The back should have some activities listed 
which teachers can briefly glance at and do 
while group is at table. Also, teacher can 
jot down games or activity she does," 

"Very gcod," 

"Serves as refresher. Teacher has opportunity 
to recall information she has forgotten," 

"Very good," 

"Good," 



5, What is your overall opinion ot the Supplementary Activities as an addition 
to tfte Bilingual Kindergarten Program? * 

"Very helpful," 

"Complements the program," ^ 

"Good ideas and has been somewhat helpful when 
found, the time and appropriate occasion," 
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y^ry good." 
Excellent." 



I think it should be part of the curriculum 
to expose teachers to different ideas." 



VGood." 

Would you recommend the Sjupplementary Activities to ot 
Bilingual Kindergarten Pri0gram? Why? 

^ I 

i j "Yes. If you are a new teac 



with the program it comes ip very handy." 

ideas provided 



/ "Yes. Because the different 
help teachers vary from, eve; 



ler teachers of the 



ler or unfamiliar 



y day '^ethods used 



"Yes. It would help a teacher get a better 
introduction to the program." 



"Yes, 



It helps with the lesson especially 



wirh some children." 



'Yes. Activities are not hard, and they are 
at your fingertips." 



Do you feel the time spent using the Supplementary Activities aided your 
overall teaching? 

"Yes." 

In what ways did you use the Supplementary Activities? Please checks 
Star the one way in which you use<: them most. 

As remedial activities for childrein who did not do the regular lessons. 

selected 9 times out of 12 

As reinforcement activities for children who needed more iu&cruction 
* selected 7 times ouc of 12 

As alternate activities to substitute for the basic curriculum. 

selected 5 times out of 12 

As additional activities for children who enrolled late. 

selected 5 times out of 12 

I 

As expansion activities to add to the basic curriculum. 

selected 3 times out of 12 
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REVIEW OF SUPPLEMENTARY ACTIVITIES 

* 

The following report will provide an evaluation of the Supplementary 
Activities - Level K. General suggestions for modification will be included* 
Other specific revisions, additions and deletions have been provided on the 
af.tivity cards themselves. 

Format and St yl^ 

The placement of the Activities on color-coded cards facilitates 
-idervt4:^^at4on-a« d retri eval of information. Although the system of 
referencing from one set of cards to another appears complex initially, 
the system is easily managed after some familiarity is established. 

The manner in which the information is organized is consistent in 

th^ majority of the activities; however, several of the cards do not adhere 

I 

to the basic format and need to be reorganized. That is, most of the cards 

I 

initially prompt the teacher to look for causes of the child's failure in 

j 

the ejivironment and encourage informal assessment before providing specific 
remedial techniques. Information on all cards should be organized in this 

manner for consistency and because this is a more positive approach which 

1 

allows the teacher to analyze the interaction of child and environment 
rather than focusing solely on the child's deficit. The cards then are 
not only "activity cards" but also cards which provide diagnostic information 
and sugge^tipns and techniques for management of the classroom environment 
to facilitate learning. 

Titles provided for each activity card need to be checked and be 
made parallel. Although the great majority of the cards are organized so 

/ 
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that each number represents a separate and free-standing activity or 
suggestion, a few need to be regrouped (i.e,, 1, 2 & 3 combined) so that * 
the 'information needed for completion of one activity does not appear on 
" several items* 

The cards are written in simple, easily understandable language, 
Tl|e "in format ion concisely presented and generally non- ambiguous. In a 
number of cases, however, a statement is made which needs to be expanded 
to inclucje a clarification of how th'e item is related to the goal 
specified at the top of the card. 

Evaluation of Content 

The quality of the task-ana(lysis on the activity cards is generally 
adequate and in many cases (especially the last one-third of the cards) 
♦is quite excellent. Application of child development and learning theories 
is very evident. Although a few changes concerning the appropriateness 
of a suggestion for the remediation of a given deficit area are needed 
(i.e., delete a sound discrimination activity for improvement of sound 
localisation) , the great majority of the suggestions are appropriate to 
the area specified. Furthermore, almos*** all of the activities utilize 
mate^irials Which are easily obtainable Dy classroom teachers. 

; 

Utljlity of Supplementary Activities 

Each card contains a great deal of information necessary for teachers 

o£ young children. The idea of providing several suggestions and approaches 

I / 
iifistead of concentrating and elaborating on one suggestion, provides the 

tJeachers with several alternatives when faced with a child who cannot 

.lucceed in the regular curriculum. 
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Many teachers, especially those who are inexperienced, find it difficult 
to pinpoint the possible sources of a child's problem and to break down 
a task in order to facilitate teaching. The activity cards address 
themselves to both these difficulties and do so without requiring the ' 
teacher to read an excessive amount of information. The activity cards 

r 

provide a framework by which a teacher can increase his/her awareness of 
the interaction of a child and his home and school environment and the 
importance which this has on learning. Observation skills and skills in 
individualized instruction can also be enKanced if the supplemental 
activities are utilized effectively. 



Elena Cano Luderus 



Date 
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THE ABILITY DEVELOPMENT PROGRAM 



The purpose of the Ability Development Pi;^gram 
is to develop and test materials which W/ill help 
teachers of the Bilingual Kindergarten' and Early 
Cb'ldhood Programs in working with children who 
are also handicappeld. Products under development 
include classroom assessment instruments, supple- 
mentary activities for children, and information 
manuals for teachers and ^parents. 
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SPANISH/ENGLISH LANGUAGE 
PERFORMANCE SCREENING (S/ELPS) 



The SyELPS provides the classroom teacher with 
an objective means of identifying the child's stron- 
ger language for classroom instructional purposes, ^ 
It may also be used to identify the child's better 
language for additional testing. The S/ELPS re- 
quires about ten minutes to administer. The 
S/ELPS kit includes recording fornls, pictures, ob- 
jects, and a detailed manual. 



OBSERVATION CHECKLIST FOR REFERRAL 
(OCR) 



The CX^R is designed to a4ist the classroom teach- 
er in identifying those children in need of referral 
for additional testing and/or medical evaluation. 
The OCR includes a manual and recording forms 
for a General Checlclist and six Specific Checklists 
for the areas of health, vision, hearing, speech, 
motor, and social/emotional development, 
(English and Spanish versions) 
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WORKING WITH PARENTS OF HANDICAPPED 
CHILDREN 



Written as a guide for teachers with little formal 
training in working with parents of handicapped 
children, this manual is designed to develop aware- 
ness of the feelings and reactions of parents. In 
addition, planning for parent interviews and parent 
observations, and lists of other resources are in- 
cluded. . ^ 

(English and Spanish versions) 




HOW TO FILL YOUR TOY SHELVES WITHOUT 
EMPTYING YOUR POCKETBOOK 

This manual includes detailed dij^ections on how to 
make inexpensive instructional materials for home 
or classroom use. Suggestions fdr specific activities 
*as well as instructions for conducting a Parent- 
Teacher materials workshop are [included. 
(English and Spanish versions) 




SUPPLEMENTARY CLASSROOM ACTIVITIES 



The Supplementary Activities are designed to be 
used in conjunction with the Bilingual Kinder- 
garten or Early Childhood Programs previously- de- 
veloped by the Southwest Educational Develop- 
ment Laboratory, Observation Cards and Activity 
Cards, are designed to provide the teacher with a 
means of identifying the specific educational needs 
of individual children. 



The Ability Development Project is funded by Bu- 
reau of Education for the Handicapped, U,S,O.E.- 
H,E.W,, Grant GOO-75-00592: 



For additional information contact: 



Dr, Joyce Evans 

Director - Division of Special Projects 
Southwest Educational Development Laboratory 
211 East 7th 
Austin, Texas 78701 



WORKING WITH PARENTS OF HANDICAPPED 



CHILDREN 



Written as a ghide for teachers with little formal 
training in workTng with parents of handicapped - 
. children, this manual is designed to develop aware- 
. ness of the feelings and reactions of parents. In 
addition, planning for parent interviews and parent 
obser/ations, and lists of other resources are in- 
. eluded. 

(English and Spanish versions^ 




HOW TO FILL YOUR TOY SHELVES WITHOUT 
EMPTYING YOUR POCKETBOOK 



This manual includes detailed directions on how to 
make inexpensive instructional materials for home 
or plassroom use. Suggestions for specific activities 
as well as instructions for conducting a Parent- 
Teacher materials workshop arie included,^'' 
(English and Spanish versions) 



SUPPLEMENTARy CLASSROOM ACTIVITIES 



The Supplementary Activities are designed to be 
used in conjunction with the Bilingual Kinder- 
garten or Early Childhood Programs previously de- 
veloped by the Southwest Educational Develop- 
ment Laboratory. Observation Cards and Activity 
Cards are designed to provide the teacher with a 
means of identifying the specific educational needs 
of individual children. 



The Ability Development Project is funded by Bu- 
reau of Education for the Handicapped, U.S.O.E.- 
H.E.W., Grant GOO-75-00592. 



For additional information contact: 



Dr. Joyce Evans 

Director - Division of Special Projects 
Southwest Educational Development Laboratory 
'211 East 7th 
Austin, Texas 78701 
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THE ABILITY DEVELOPMENT PROGRAM 



the purpose of the Ability Development Program 
is to develop and test materials' which will help 
w teachers of the Bilingual Kindergarten and Early 
Childhood Programs in working with children who 
are also handicapped. Products under development 
^. include classroom assessment instruments, suppie- 
.^mentary activities for children, and information 
manuals for teachers and parents. 



SPANISH/ENGLISH LANGUAGE 
PERFORMANCE SCREENING (S/ELPS) 



The S/ELPS provides the classroom teacher with 
an objective means of identifying the child's stron- 
ger language for classroom instructional purposes. 
It may also be used to identify the child's better 
language "for additional testing. The S/ELPS re- 
quires about ten minutes to administer The 
S/ELPS kit includes recording forms, pictures, ob- 
jects, and a detailed manual. 



OBSERVATION CHECKLIST FOR REFERRAL 
(OCR) 



The OCR is designed to assist the classroom teach- 
er in identifying those children in need of referral 
for additional testing and/or medical evaluation. 
The OCR includes a manual and recording forms 
tor a General Checklist and six Specific Checklists 
lor the areas of health, vision, hearing, speech, 
motor, and social/emotional development. 
(English and Spanish versions) 



THE 
ABILITY 
DEVELOPMENT 
PROGRAM 




SPKCIAI. PROJKCTS 
Southwest Kducational Development Laboratory 
Austin, Texas 
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I HK ABILI TY DEVKIOPMLN F PROGRAM 

New products- 

Dcsii»nc(l for teachers using the Bilingual 
Kindergarten Program (SEDL, 1972), with 
sonic of the materials helpful for teachers 
using other curriculum; 
Tested in kindergarten classrooms through- 
out the country 

And nowavailahlc: 

Spanisli/Knglish I^uiguage Performance 

Screening (S/I:LPS) 

A measure of language dominance, de- 
signed for use hy the teacher or other 
examiner with fcUu- through eight-year- 
old children. 

Working with Parents of Handicapped CHiil- 
dren 

A manual (Spanish and English versions) 
with a positive approach for interviewing 
and working with parents, designed for 
use hy all teachers who have one or more 
handicapped children in the classroom. 

How to Fill Your Toy Shelves Without 

Emptying Your PocketfK)ok 

A manual with detailed directions for 
making inexpensive instnictional materi- 
als for the home or the classroom, de- 
signed for u.se hy all *eachers of young 
children. 

Supplementary Materials 

Supplementary inform:jtion and activi- 
ties for children with learning problems, 
designed specifically for use with the Bi- 
» lingiial Kindergarten Program. 
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SPANISH/ENGLISH LANGUAGE 
PERFORMANCE SCREENING (S/ELPS) 

S/ELPS provides an objective method for 
evaluating tl* 'oniinanl oral language of 
foui;- through eight-year-old children. 

S/ELPS vomparc;^ a chikPs performiuice in 
one language with his/her performance in 
another; it does not compare one child 
with others. Parallel activities are offered in 
Spani.sh and English. 

S/ELPS is (Wsigned to he 

• administered and scored in less than 15 
minutes hy any nilingual person 

• used as a guide for teaching" children a 
new hmguage and for grouping children 
for classroom activities 

• enjoyed hy and of interest to young chil- 
dren and conducive to their verbal learn- 

S/ELPS lest kit contains 

• Test manual, with directions for admin- 
istering and scoring, suggestions for 
teaching and gi'ouping, and technical in- 
formation 

• Recording forms in Spani.sh and English 

• Two .special boxes: 
^ Box I (Spanish) 

cup, plate, spoon, comb, mirror, 
watcii 
Box II (English) - 
baby, bottle, bed, chair, table, 
scissors 

• Foin* color pictures 

La pinata. El bano, Playgroinul, 
Clown 

• Publisher: CTB/McGraw-i lill, 

Del Woxnc Rt earch Park 
Monterey, CA 93940 



WORKING WITH PARENTS OF HANDI- 
CAPPED CHILDREN AND TRABA- 
JANDO CON LOS PADRES DE NINOS 
CON IMPEDIMENTOS 

Manuals (Spanish and English) for those 
with liule or no formal training in working 
with parents of handicapped children. 
Topics include: 

■ Understanding How Parents Feel 
Knowing Your Own Feelings 
•Meeting with Parents 
. Following Up the Meeting 
Organizations, sources of information, 
books, and pamphlets for teachers and par- 
ents are listed in the appendix. 

HOW TO FILL YOUR TOY SHELVES 
WITHOUT EMPTYING YOUR POCKET- 
BOOK AND COMO LLENAR SU$ 
ESTANTES CON JUGUETES SIN 
GASTAR MUCHO DINERO 

Instructions for making and using manipu- 
lative learning equipment for use with 
handicapped and non-handicapped young 
children in day care centers, classrooms, 
and home; and directions for planning and 
conducting a materials workshop. Equip- 
ment can be made by teachers, assistants, 
and. parents or in a group workshop. 

Manuals available from 
The Council for Exceptional Children 
1920 Association Di^W 
Reston,VA 22091 

Working with Parents - S3. 25 each 
How to Fill Your Toy Shelves 

English-Stock No. 130 - S3.95 each 
Spanish-Stock No. 134 - S3. 95 each 



SUPPLEMENTARY MATERIALS FOR THE BIUNGUAL KINDERGARTEN PROGRAM 

Diagnostic and remedial materials have been developed to supplement- the Bilingual Kinder- 
garten Program (BKP). These materials provide a means of identifying needs and individualiijing 
instruction for the handicapped child within the regular BKP. 



The Supplementary Materials include: 

Instruclional Guide - How to use the sup- 
plementary materials. 

Entr y Level Checklists - Provide an organ- 
ized method for observing each child dur- 
ing the first two weeks of kindergarten. 

Observation Cards - For use in identifying 
specific behaviors in the Visual, Auditory, 
Motor, and Ideas and Concepts lessons and 
to provide immediate techniques for sim- 
plifying the task or determining where 
skills break down. 

Information Cards - Provide general infor- 
mation, ways of handling problems, sug- 
gestions for classroom management, and 
specific information on different types of 
handicapping conditions. 

Action Cards - Provide alternate ways of 
teaching a task or smaller step activities for 
meeting and reinforcing lessoh objectives. 

Home Activities - Supplement classroom in- 
struction in the Visual, Motor, Auditory, 
and Ideas and Concepts lessons. 



SupplemeH&ry Media - Illustrate cl)ildren 
with handicapping. conditi^s or problems 
such as children with glasses, hearing aids, 
or braces. 

The Supplementary Materials can be used 
by any teacher, assistant teacher, or team 
of teachers using the basic Bilingual Kinder- 
g arten Program (BKP). The Observation 
ards. Home Activities, and Supplementary 
iedia are keyed to activities in the basic 
Bf^P. In addition to use with handicapped 
children, the Supplementary Materials have 
also\been used Successfully with non-handi- 
cappp'd children who have difficulty in 
meeting objectives of the BKP curriculum. 



For additional information or a 
sample, of the materials, please 
write or call: 

Joyce Evans, Ph.D. 
Director, Special Projects or 
Rcbeca Zuniga, Adult Trainer 
Southwest Educational 

Development Laboratory 
211 East 7th Street 
Austin, Texas 78701 



512/476-6861 
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Spanish /English Language 
Performance Screening 

(S/ELPS) 

The Spanish/English Language Performance Streiinq 
(S/Elps) instrunrient provides an objective methorf^ 
evaluating the dilld's stronger or dominant languagi 
for Initial instruction In a bilingual program. It Is de- 
signed for the classroom teacher to use at the begin- . 
ning of the school year so the child can be taughTin 
his stronger language without an extended period of 
obsen/atlon. Other examiners wjll find It useful for 
determining the better language(s) for administration 
of other tests. ^ 

The S/ELPS comperes the child's performance in one 
language with his performance in the other. It does " 
not compare one child to another nor to the rest of 
the children his age. Parallel, not identical, activitlei 
are included In Spanishrand in English. The test takes 
about 15 minutes to administer and score and m«y be 
administered by any bilingual person who teaches and 
works with young children. 

The S/ELPS Is designed to be 

.Useful to the classroom teacher without special 
training In testing 

. Interesting and enjoyable for young children so they 
will verbalize freely 

. Helpful to teachers In getting to know each child 
individually as well as in learning the better language 
for communicating and teaching 

. Effective as a guide to initial teaching language and 
grouping of children for classroom activities 

. Convenient to administer and score 



. • THE ABILITY DEVELOPMENT PROGRAM ■ ... 

SUPPLEMENTARY MATERIALS FOR THE BILINGUAL KINDERGARTEN PROGRAM 

The Ability Development Program is designed to supplement instruction for 
children enrolled in the Bilingual Kindergarten Program developed in 1974 
/ by the Southwest Educational Development Laboratory. Materials for the 

/ . Ability Development Program are designed for children with mild to moderate 

handicapping conditions. However, the materials^ can also be used as a 
supplement for any child, handicapped or normal, who is having difficulty 
in learning. 

Supplementary materials of the Ability Development Program include an in-- 
struct ional guide, entry level checklists, a set of 5 x 8 index cards, and 
media. A brief description is ^s follows: 

1. Instructional Guide - Use of the supplementary card file, as well 
as background information on the development of the supplementary 
materials is described. ^ 

2. Entry Level Checklists Provide an organiz^ed method of observation 
■of the child's ability to function in the preschool setting, as 

well as references to specific information on handling problems 
and classroom management. 

3. Observation Cards - Designed to be used with Visual, Auditory, 
Motor, and Ideas and Concepts lessons of the Bilingual Kinder- 
garten Program , each Observation Card identifies specific behaviors 
to observe in each lesson. 

4. Information Cards - General Information on types of problems which ■ ^ 
may arise and ways of handling' problems, suggestions for classroom 
management and adaptations are described as well as specific infor- 
mation on different types of handicapping conditions. 

5. Activgty Cards - "Specific activities which provide alternate ways 
of teaching a bask, smaller step activities for meeting lesson 
objectives, and reinf oircement activities are listed as followup 
instruction for observations. 

6. Media - Additional media required for using the Activity cards is 
included. (Media from the Bilingual Kindergarten Program has been 
used for the supplementary activities whenever" possible. ) 

These supplementary materials can be used by any teacher or team of 
teachers who are using the basic Bilingual Kindergarten Program (BKP). 
They are not designed to be used independently of th ^BKP at this time. 
The Card File can .serve any number of children; however\"no more than 
three or f our ^"teachers who work as a team should share a X^e. Both 
teachers and a£3sistant teachers can make observations, foliiaw the infor- 
mational instructions, and teach the activities. \ 

For additional information or a sample of the materials, please WUe: 

Joyce Evans, Ph.D. 

Director, Ability Development Program 
Southwest Educational Development Laboratory 
211 East 7th- Street 
Austin, Texas 78701 
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HOW to FILL YOUR TOY SHELVES WITHOUT EMPTYING YOUR POCKETBOOK 

and 

como'llenar sus estantes con juguetes sin GASTAR MUCHO DINERO 



Gaines, activities, and instructions for making manipulative learning equip- 
ment are included in these manuals. The equipment and activities have been de- 
signed to be used with handicapped and nonhandicapped young children' in day 
care centers, classrooms, and at home, ^ 

All items can be made from things which can be s/ived in th^^^home, such as 
emp^ty bottles and cans; from scraps, such as lumber and fabrics'; ^from materials 
usually* found in preschool centers or classrooms, such as block^^ beads, and 
pcgboards; or from things which can be purchased 'in variety stores. Instructions 
for constructing several types of equipment, ranging from adult instructional 
aids, such as a felt board, to activities and games for children are included* 
All items are adaptable for small group or individual use. The equipment can be 
made by individual teachers, assistant teachers, and- parents, or in a group work- 
shop. 

All instructions were tested by te^achers and parents during a materials work- 
shop, .Directions for planning and conducting a similar materials workshop are 
detailed. Materials to be collected or purchased and the necessary tools and 
supplies are listed along with suggestions for arranging the workshop space into 
specific work areas, •'^ 

Activities for using each item with children follow the directions for 
making equipment. Activities are included for developing skills in "the follow- 
ing areas: Visual, Auditory, Gross Motor, Fine Motor, and Language and Concept 
Development, 

These manuals were developed as a part of the Ability Development Project 
of Southwest Educational Development Laboratory and funded by a grant from Bureau 
of Education for the .landicapped. . ^ 

The manuals are available from: 

The Council for Exceptional Children 
1920 Association Drive 
Reston, Virginia 22091 

Stock No. 130 - Enj'J Ish Version 
Stock No, 13A - Spanish Version 
$3.95 each 



Joyce Evans, Ph.D. 
Director, Special Projects 
Southwest Educational 

Development Laboratory 
2J1 East 7th Street 
Austin, Texas 78701 
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WORKING WITH PARENTS OF HANDICAPPED CHILDREN 

' and 

TRABAJANDO CON LOS .PADRES DE NINOS CON IhffEDlMENTOS 



Practical considerations and suggestions for working with parents of 
children with existing and/or potentially liandicapping conditions ai;e the 
focus of this manual. Written for those who have had little or no formal 
training in working with parents of handicapped cliildren, the manual is 
particularly useful for day care, Head Start, and elementary schooO. teachers. 

Information on feelin-gs and attitudes wliich may be encounte/ed., specific 
suggestions on planning for meetings v/ith parents, and guideiin(/s for developing 
referral information and files are included, A "question and aiiswer" format is' 
followed in addressing cri tical situations and questions frequently asked by 
teachers and preschool staffT Major topics included are: Understanding How 
Parents Feel, Knowing Your Own Feelings, Meeting With Parent/, and Following 
Up the Meeting, 

Sources from which teachers and parents may obtain additional information 
related to specific types oi handicaps are provided in the' appendices. Bibliog- 
raphies include: General Information and Activities, Personal Narratives, and 
Suggested Readings on tlie Handicapped, In addition, sample forms and suggestions 
for conducting parent interviews are included, / ^ 

Working; with Parents of Handicapped Children wa§ c/eve loped as a part of the 
Ability Development Project, funded by a grant from the Bureau of Education for 
the Handicapped. The manual is available in English or in Spanish (Trabajando 
con los padres de ninos con impedimentos ) , I 

The manuals may be ordered from: / 

/ 

The Council for Exceptipnal Children 
1920 Association Drive 
Reston, Virginia 2209] 



Stock No, 132 - English Version 
Stock No, 133 - Spanish Version 
$3,25 each . 



Joyce Evans, Ph.D. ^ 
Director, Special Projects 
Southwest Educational 
' DeveJopmcnt Laboratory 
211 East 7th Street 
Austin, Texas 78701 
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OBSERVATIONAL CHECKLISTS FOR REFERRAL 
(Field Test Version) 



The Observational Checkli sts for Referral (OCR) are being developed as a 
guide for teachers an'd assistant teachers of young children. The OCR helps / 
teachers identify problems that interfere with learning, make appropriate 
referrals to other professionals, and communicate with parents and professionals. 

The OCR includes an informational manual for the teacher, a General Check- 
list to be completed for each child, and Specific Checklists to be completed only 
for- children identified on the General Checklist. Items on .the General Checklist 
are designed tor initial identification purposes. Stated in broad terms, these 
items cover common physical or behavioral symptoms of ifroblems. Each item on the 
General Checklist relates to one or more Specific Checklists which describe unusual 
behaviors or .physical symptoms in greater detail. The Specific Checklistf* represent 
the areas of Health, Vision, Hearing, Speech and Language, Motor, Learning, and 
Behavior, and provide information about the child which leads to referral and a 
more comprehensive evaluation by other professionals. 

The OCR manual includes detailed instructions for completing each' checklist 
a general discussion of each Specific Checklist and the problem area it is de- 
signed to identify, descriptions of common behavioral . manifes tations of those 
, problems, and guidelines for making and following up refcfrals. Observational 
skills and techniques are explained, as well as descriptions of the specific 
behaviors the teacher should note. Ht^^mi- 

The OCR has been pilot tested by teachers and assistant teachers in Head 
Start and Day Care Centers, and has been reviewed by a team of external con- 
sultants representing the fields of Speech Pathology, Audiology, Early Child- 
hood, Special liducation, an-^ Nursing. A research study comparing teacher- 
administered OCR results with screening evaluations performed by SEDL staff 

^nLrJ; o^'Jh I'^^f''^^''^^?^'"'"^^ ""^''^^ psychologist, educational diagnostician, 
fUT. r?°^°Si-sts, aud.ologist, pediatrician, and nurses), has been Conducted. 
IrltiT^ '^^'^"^ external consultants, and research data have 

provided the basis for this Field Test Version of the OCR. • 



Joyce Evans, .Ph.D. 

Director, Ability Development Program 
Southwest Educational Development Laboratory 
211 Kast 7tli Street 
Austin, Texas 78701 
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